Nov 03 17:12:15 devstack cinder-volume[75889]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 17:12:15 devstack cinder-volume[75889]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 17:12:15 devstack cinder-volume[75889]: we strongly recommend against using it for new projects. Nov 03 17:12:15 devstack cinder-volume[75889]: If you are already using Eventlet, we recommend migrating to a different Nov 03 17:12:15 devstack cinder-volume[75889]: framework. For more detail see Nov 03 17:12:15 devstack cinder-volume[75889]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 17:12:15 devstack cinder-volume[75889]: import eventlet # noqa Nov 03 17:12:18 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:12:18 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:12:18 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:12:19 devstack cinder-volume[75889]: INFO dbcounter [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Registered counter for database cinder Nov 03 17:12:19 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:12:20 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writer thread running {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:12:20 devstack cinder-volume[75889]: INFO cinder.rpc [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 17:12:20 devstack cinder-volume[75889]: INFO cinder.rpc [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 17:12:20 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:12:20 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Determined volume DB was empty at startup. Nov 03 17:12:20 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75889) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 17:12:20 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 17:12:20 devstack cinder-volume[75889]: WARNING stevedore.named [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 17:12:20 devstack cinder-volume[75889]: WARNING castellan.key_manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:12:20 devstack cinder-volume[75889]: WARNING cinder.keymgr.conf_key_mgr [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:12:20 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75889) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 17:12:20 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.623s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:12:21 devstack cinder-volume[75889]: INFO cinder.rpc [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 17:12:21 devstack cinder-volume[75889]: INFO cinder.rpc [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 17:12:21 devstack cinder-volume[75889]: WARNING stevedore.named [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 17:12:21 devstack cinder-volume[75889]: WARNING castellan.key_manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:12:21 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:12:21 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Starting 1 workers Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Started child 76101 {{(pid=75889) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Full set of CONF: {{(pid=75889) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] ******************************************************************************** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 17:12:21 devstack cinder-volume[76101]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Configuration options gathered from: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] ================================================================================ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] allow_availability_zone_fallback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] allow_compression_on_image_upload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] allowed_direct_url_schemes = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] api_rate_limit = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] auth_strategy = keystone {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] az_cache_duration = 3600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_host = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_stats_polling_interval = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backup_api_class = cinder.backup.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backup_name_template = backup-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backup_use_same_host = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backup_use_temp_snapshot = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] chap_username = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_internal_tenant_project_id = 2aa17b5401f640d8b3fd10448f916ffe {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_internal_tenant_user_id = e3ae005260844a8d9522424bc094b326 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cloned_volume_same_az = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cluster = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] compression_format = gzip {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] compute_api_class = cinder.compute.nova.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] config_dir = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] config_source = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] control_exchange = openstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] debug = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] default_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] default_group_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] default_volume_type = lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_ssl_cert_verify = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] driver_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] enable_force_upload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] enable_new_services = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] enable_unsupported_driver = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] enabled_backends = ['lvmdriver-1'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] enforce_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_api_insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_api_servers = ['http://192.168.122.123/image'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_api_ssl_compression = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_ca_certificates_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_catalog_info = image:glance:publicURL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_num_retries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance_request_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] graceful_shutdown_timeout = 5 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] group_api_class = cinder.group.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] host = devstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_compress_on_upload = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_conversion_address_space_limit = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_conversion_cpu_limit = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_conversion_disable = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_introspection_address_space_limit = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_introspection_cpu_limit = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_upload_use_cinder_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_upload_use_internal_tenant = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_volume_cache_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_volume_cache_max_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] image_volume_cache_max_size_gb = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] init_host_max_objects_retrieval = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] instance_format = [instance: %(uuid)s] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iscsi_target_flags = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iscsi_write_cache = on {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iser_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iser_ip_address = 192.168.122.123 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iser_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_color = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_config_append = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_options = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_rotate_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_rotate_interval_type = days {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] log_rotation_type = none {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] max_age = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] max_logfile_count = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] max_logfile_size_mb = 200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] max_over_subscription_ratio = 20.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] message_reap_interval = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] message_ttl = 2592000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] migration_create_volume_timeout_secs = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] monkey_patch = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] monkey_patch_modules = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] my_ip = 192.168.122.123 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] no_snapshot_gb_quota = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] num_iser_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] num_shell_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] num_volume_device_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] nvmeof_conn_info_version = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] nvmet_ns_id = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] nvmet_port_id = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_max_limit = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_ext_list = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_listen_port = 8776 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] osapi_volume_workers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] per_volume_size_limit = -1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] periodic_fuzzy_delay = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] periodic_interval = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] public_endpoint = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] publish_errors = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_backup_gigabytes = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_backups = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_gigabytes = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_groups = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_snapshots = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] quota_volumes = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] rate_limit_burst = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] rate_limit_except_level = CRITICAL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] rate_limit_interval = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] reinit_driver_count = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] report_discard_supported = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] report_interval = 120 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] reservation_clean_interval = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] reservation_expire = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] reserved_image_namespaces = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] reserved_percentage = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] rpc_response_timeout = 120 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] run_external_periodic_tasks = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] scst_target_driver = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_down_time = 720 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] shell_completion = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] snapshot_name_template = snapshot-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] snapshot_same_host = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] state_path = /opt/stack/data/cinder {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] storage_availability_zone = nova {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] storage_protocol = iSCSI {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] syslog_log_facility = LOG_USER {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_helper = lioadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_ip_address = 192.168.122.123 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] target_secondary_ip_addresses = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] transport_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] until_refresh = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_chap_auth = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_default_quota_class = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_journal = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_json = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_stderr = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] use_syslog = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] verify_glance_signatures = enabled {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_api_class = cinder.volume.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_clear_size = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_copy_bps_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_dd_blocksize = 1M {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_name_template = volume-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_service_inithost_offload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volume_usage_audit_period = month {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] zoning_mode = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_concurrency.disable_process_locking = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.auth_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.cache = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.include_service_catalog = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.interface = public {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcache_username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.service_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.backend = dogpile.cache.null {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.backend_argument = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.backend_expiration_time = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.config_prefix = cache.oslo {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.debug_cache_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.enable_retry_client = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.enable_socket_keepalive = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.expiration_time = 600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.hashclient_retry_attempts = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_dead_retry = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_pool_maxsize = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_sasl_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.proxies = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.redis_db = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.redis_server = localhost:6379 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.retry_attempts = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.retry_delay = 0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.socket_keepalive_count = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.socket_keepalive_idle = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.socket_keepalive_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.socket_timeout = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.tls_allowed_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.tls_cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.tls_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.tls_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.tls_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cache.username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] coordination.backend_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.asyncio_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.asyncio_slave_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.backend = sqlalchemy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.connection_debug = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.connection_parameters = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.connection_recycle_time = 3600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.connection_trace = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.db_inc_retry_interval = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.db_max_retries = 20 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.db_max_retry_interval = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.db_retry_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.max_overflow = 50 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.max_pool_size = 5 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.max_retries = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.mysql_wsrep_sync_wait = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.pool_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.retry_interval = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.slave_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.sqlite_synchronous = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.synchronous_reader = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] database.use_db_reconnect = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_tracing.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.connection_string = messaging:// {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.es_doc_type = notification {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.es_scroll_size = 10000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.es_scroll_time = 2m {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.filter_error_trace = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.hmac_keys = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.sentinel_service_name = mymaster {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.socket_timeout = 0.1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.trace_requests = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler.trace_sqlalchemy = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler_jaeger.process_tags = {} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler_jaeger.service_name_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] profiler_otlp.service_name_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.enforce_new_defaults = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.policy_default_rule = default {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.policy_file = policy.yaml {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.group = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.helper_command = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] privsep_osbrick.user = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.group = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.helper_command = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] cinder_sys_admin.user = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.send_service_user_token = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] service_user.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] glance.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.chap_username = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.driver_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.extra_capabilities = {} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iscsi_target_flags = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iscsi_write_cache = on {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iser_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iser_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.lvm_mirrors = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.lvm_share_target = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.lvm_type = auto {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.num_shell_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.report_discard_supported = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.reserved_percentage = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.unique_fqdn_network = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.use_chap_auth = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_clear_size = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volume_group = cinder-volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_reports.file_event_handler = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_reports.log_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.backend_host = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.chap_username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.chiscsi_conf = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.driver_use_ssl = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.extra_capabilities = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iser_helper = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iser_ip_address = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iser_port = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.lvm_conf_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.lvm_mirrors = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.lvm_share_target = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.lvm_type = auto {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.num_shell_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.nvmet_port_id = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.report_discard_supported = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.reserved_percentage = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.scst_target_driver = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.storage_protocol = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_helper = lioadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_ip_address = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.use_chap_auth = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_clear_size = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] lvmdriver-1.volumes_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_notifications.driver = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_notifications.retry = -1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] key_manager.fixed_key = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.barbican_api_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.barbican_endpoint = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.barbican_endpoint_type = public {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.barbican_region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.number_of_retries = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.retry_delay = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.send_service_user_token = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.verify_ssl = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican.verify_ssl_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.auth_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] barbican_service_user.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.approle_role_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.approle_secret_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.auth_method = approle {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.auth_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.kv_mountpoint = secret {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.kv_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.kv_version = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.root_token_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.ssl_ca_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.token_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.token_role = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:12:21 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] ******************************************************************************** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 17:12:22 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:22 devstack sudo[76266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:22 devstack sudo[76266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:22 devstack sudo[76266]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.315s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:12:22 devstack cinder-volume[76101]: INFO cinder.brick.local_dev.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:22 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:22 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:22 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG cinder.brick.local_dev.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76101) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 17:12:22 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:22 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:22 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:23 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.277s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:24 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 17:12:24 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.393s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:24 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:25 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:25 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[76841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:25 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:25 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[76101]: INFO cinder.volume.drivers.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:26 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.346s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:26 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[76862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:27 devstack sudo[76862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[76862]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:27 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:27 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[76101]: INFO cinder.volume.driver [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Driver hasn't implemented _init_vendor_properties() Nov 03 17:12:27 devstack cinder-volume[76101]: DEBUG cinder.volume.driver [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76101) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writer thread running {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG cinder.db.api [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Building query based on filter {{(pid=76101) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG cinder.image.image_utils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76101) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 17:12:28 devstack cinder-volume[76101]: INFO cinder.keymgr.migration [None req-98929e69-38f6-4380-9bc2-7cbe4f717943 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:28 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:28 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:28 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:28 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:28 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:28 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:28 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:28 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:28 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:29 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.376s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:29 devstack sudo[76886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:29 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:29 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:29 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Driver initialization completed successfully. Nov 03 17:12:29 devstack cinder-volume[76101]: INFO cinder.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Initiating service 2 cleanup Nov 03 17:12:29 devstack cinder-volume[76101]: INFO cinder.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Service 2 cleanup completed. Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG cinder.service [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Creating RPC server for service cinder-volume {{(pid=76101) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG cinder.service [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76101) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 17:12:29 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:12:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:29 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:12:29 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:30 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[76899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:12:30 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[76907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:12:30 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:31 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-c2d63f5f-aa86-40fc-b11a-f34bcc78825b None None] Driver post RPC initialization completed successfully. Nov 03 17:12:31 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:39 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=3 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:41 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:13:04 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager._thread_info {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:13:04 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread count: 6 {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:13:04 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread info: [<_MainThread(MainThread, started 136092920279168)>, , , , , ] {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[81020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:14:04 devstack sudo[81020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[81020]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[81190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:14:04 devstack sudo[81190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[81190]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[81348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:14:04 devstack sudo[81348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:05 devstack sudo[81348]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:05 devstack sudo[81511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:14:05 devstack sudo[81511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:05 devstack sudo[81511]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager._thread_info {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread count: 6 {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:14:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread info: [<_MainThread(MainThread, started 136092920279168)>, , , , , ] {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:14:41 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:14:41 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:04 devstack sudo[82866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:15:04 devstack sudo[82866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[82866]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:04 devstack sudo[82869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:15:04 devstack sudo[82869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[82869]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:04 devstack sudo[82873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:15:04 devstack sudo[82873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[82873]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[82895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:15:05 devstack sudo[82895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[82895]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager._thread_info {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread count: 6 {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:15:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread info: [<_MainThread(MainThread, started 136092920279168)>, , , , , ] {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[84708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:16:04 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:16:04 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[84781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:16:04 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:05 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:05 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:16:05 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:05 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager._thread_info {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread count: 6 {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:16:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread info: [<_MainThread(MainThread, started 136092920279168)>, , , , , ] {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:16:41 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:16:41 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:04 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 17:17:04 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:04 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:04 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:17:04 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:04 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:04 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 17:17:04 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:05 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:05 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 17:17:05 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:05 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] Running periodic task VolumeManager._thread_info {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread count: 6 {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:17:05 devstack cinder-volume[76101]: DEBUG cinder.volume.manager [None req-036300ba-45fa-4d51-8d32-b876586f753b None None] thread info: [<_MainThread(MainThread, started 136092920279168)>, , , , , ] {{(pid=76101) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:17:14 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Caught SIGTERM, stopping children Nov 03 17:17:14 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Acquiring lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:14 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Acquired lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:14 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Releasing lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:14 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Stop services. {{(pid=75889) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 17:17:14 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Killing children. {{(pid=75889) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 17:17:14 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Waiting on 1 children to exit Nov 03 17:17:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Acquiring lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Acquired lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Releasing lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:14 devstack cinder-volume[76101]: WARNING amqp [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 17:17:14 devstack cinder-volume[76101]: WARNING amqp [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 17:17:14 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-6c6196e1-4c20-454b-91fd-783e8094b6fd None None] Child 76101 exited with status 0 Nov 03 17:17:15 devstack cinder-volume[86160]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 17:17:15 devstack cinder-volume[86160]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 17:17:15 devstack cinder-volume[86160]: we strongly recommend against using it for new projects. Nov 03 17:17:15 devstack cinder-volume[86160]: If you are already using Eventlet, we recommend migrating to a different Nov 03 17:17:15 devstack cinder-volume[86160]: framework. For more detail see Nov 03 17:17:15 devstack cinder-volume[86160]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 17:17:15 devstack cinder-volume[86160]: import eventlet # noqa Nov 03 17:17:17 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:17 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:17 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:18 devstack cinder-volume[86160]: INFO dbcounter [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Registered counter for database cinder Nov 03 17:17:18 devstack cinder-volume[86160]: DEBUG oslo_db.sqlalchemy.engines [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86160) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:18 devstack cinder-volume[86160]: DEBUG dbcounter [-] [86160] Writer thread running {{(pid=86160) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:17:18 devstack cinder-volume[86160]: INFO cinder.rpc [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 17:17:18 devstack cinder-volume[86160]: INFO cinder.rpc [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 17:17:18 devstack cinder-volume[86160]: DEBUG oslo_db.sqlalchemy.engines [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86160) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:18 devstack cinder-volume[86160]: INFO cinder.volume.manager [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Determined volume DB was empty at startup. Nov 03 17:17:18 devstack cinder-volume[86160]: DEBUG cinder.volume.manager [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86160) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 17:17:18 devstack cinder-volume[86160]: INFO cinder.volume.manager [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 17:17:18 devstack cinder-volume[86160]: WARNING stevedore.named [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 17:17:18 devstack cinder-volume[86160]: WARNING castellan.key_manager [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:17:18 devstack cinder-volume[86160]: WARNING cinder.keymgr.conf_key_mgr [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:17:18 devstack cinder-volume[86160]: INFO cinder.volume.manager [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 17:17:18 devstack cinder-volume[86160]: DEBUG oslo_db.sqlalchemy.engines [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86160) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:21 devstack cinder-volume[86160]: INFO oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Starting 1 workers Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Started child 86387 {{(pid=86160) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Full set of CONF: {{(pid=86160) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] ******************************************************************************** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Configuration options gathered from: {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] ================================================================================ {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 17:17:21 devstack cinder-volume[86387]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] allow_availability_zone_fallback = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] allow_compression_on_image_upload = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] allowed_direct_url_schemes = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] api_rate_limit = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] auth_strategy = keystone {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_availability_zone = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_host = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_stats_polling_interval = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backup_api_class = cinder.backup.api.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backup_name_template = backup-%s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backup_use_same_host = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backup_use_temp_snapshot = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] chap_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] chap_username = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_internal_tenant_project_id = 2aa17b5401f640d8b3fd10448f916ffe {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_internal_tenant_user_id = e3ae005260844a8d9522424bc094b326 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cluster = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] compression_format = gzip {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] compute_api_class = cinder.compute.nova.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] config_dir = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] config_source = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] control_exchange = openstack {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] debug = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] default_availability_zone = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] default_group_type = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] default_volume_type = QuobyteHD {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] disk_geometry = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_client_cert = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_client_cert_key = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_data_namespace = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_ssl_cert_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_ssl_cert_verify = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] driver_use_ssl = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] enable_new_services = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] enable_unsupported_driver = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] enabled_backends = ['QuobyteHD'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] enforce_multipath_for_image_xfer = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] filter_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_api_insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_api_servers = ['http://192.168.122.123/image'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_api_ssl_compression = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_ca_certificates_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_catalog_info = image:glance:publicURL {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_num_retries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance_request_timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] goodness_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] graceful_shutdown_timeout = 5 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] group_api_class = cinder.group.api.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] host = devstack {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_compress_on_upload = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_conversion_address_space_limit = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_conversion_cpu_limit = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 17:17:21 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.remotefs [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86387) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_conversion_disable = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_introspection_address_space_limit = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_introspection_cpu_limit = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_upload_use_cinder_backend = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_upload_use_internal_tenant = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_volume_cache_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_volume_cache_max_count = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] image_volume_cache_max_size_gb = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] init_host_max_objects_retrieval = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] instance_format = [instance: %(uuid)s] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iscsi_target_flags = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iscsi_write_cache = on {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iser_helper = tgtadm {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iser_ip_address = 192.168.122.123 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iser_port = 3260 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_color = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_config_append = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_dir = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_options = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_rotate_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_rotate_interval_type = days {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] log_rotation_type = none {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] max_age = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] max_logfile_count = 30 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] max_logfile_size_mb = 200 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] max_over_subscription_ratio = 20.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] message_reap_interval = 86400 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] message_ttl = 2592000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] migration_create_volume_timeout_secs = 300 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] monkey_patch = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] monkey_patch_modules = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] my_ip = 192.168.122.123 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] no_snapshot_gb_quota = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] num_iser_scan_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] num_shell_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] num_volume_device_scan_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] nvmeof_conn_info_version = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] nvmet_ns_id = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] nvmet_port_id = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_max_limit = 1000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_ext_list = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_listen_port = 8776 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_use_ssl = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] osapi_volume_workers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] per_volume_size_limit = -1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] periodic_fuzzy_delay = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] periodic_interval = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] public_endpoint = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] publish_errors = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_backup_gigabytes = 1000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_backups = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_gigabytes = 1000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_groups = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_snapshots = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] quota_volumes = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] rate_limit_burst = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] rate_limit_except_level = CRITICAL {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] rate_limit_interval = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] reinit_driver_count = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] replication_device = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] report_discard_supported = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] report_interval = 120 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] reservation_clean_interval = 86400 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] reservation_expire = 86400 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] reserved_image_namespaces = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] reserved_percentage = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] rpc_response_timeout = 120 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] run_external_periodic_tasks = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] scst_target_driver = iscsi {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] scst_target_iqn_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_down_time = 720 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] shell_completion = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] snapshot_name_template = snapshot-%s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] split_loggers = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] state_path = /opt/stack/data/cinder {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] storage_availability_zone = nova {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] storage_protocol = iSCSI {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] syslog_log_facility = LOG_USER {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_helper = lioadm {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_ip_address = 192.168.122.123 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_port = 3260 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_protocol = iscsi {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] target_secondary_ip_addresses = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] trace_flags = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] transport_url = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] until_refresh = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_chap_auth = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_default_quota_class = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86387) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 17:17:21 devstack cinder-volume[86387]: WARNING cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 17:17:21 devstack cinder-volume[86387]: WARNING cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_journal = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_json = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_multipath_for_image_xfer = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_stderr = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] use_syslog = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] verify_glance_signatures = enabled {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_api_class = cinder.volume.api.API {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_backend_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_clear = zero {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_clear_ionice = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_clear_size = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_copy_bps_limit = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_dd_blocksize = 1M {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_name_template = volume-%s {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_service_inithost_offload = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volume_usage_audit_period = month {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] zoning_mode = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_concurrency.disable_process_locking = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.auth_section = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.auth_type = password {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.auth_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.cache = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.include_service_catalog = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.interface = public {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcache_username = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.region_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.service_type = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.backend = dogpile.cache.null {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.backend_argument = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.backend_expiration_time = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.config_prefix = cache.oslo {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.debug_cache_backend = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.enable_retry_client = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.enable_socket_keepalive = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.expiration_time = 600 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.hashclient_retry_attempts = 2 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_dead_retry = 300 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_pool_maxsize = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_sasl_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.proxies = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.redis_db = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.redis_server = localhost:6379 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.retry_attempts = 2 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.retry_delay = 0.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.socket_keepalive_count = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.socket_keepalive_idle = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.socket_keepalive_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.socket_timeout = 1.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.tls_allowed_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.tls_cafile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.tls_certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.tls_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.tls_keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cache.username = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] coordination.backend_url = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.asyncio_connection = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.asyncio_slave_connection = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.backend = sqlalchemy {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.connection = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.connection_debug = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.connection_parameters = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.connection_recycle_time = 3600 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.connection_trace = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.db_inc_retry_interval = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.db_max_retries = 20 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.db_max_retry_interval = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.db_retry_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.max_overflow = 50 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.max_pool_size = 5 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.max_retries = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.mysql_wsrep_sync_wait = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.pool_timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.retry_interval = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.slave_connection = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.sqlite_synchronous = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.synchronous_reader = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] database.use_db_reconnect = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:21 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_tracing.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.connection_string = messaging:// {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.es_doc_type = notification {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.es_scroll_size = 10000 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.es_scroll_time = 2m {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.filter_error_trace = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.hmac_keys = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.sentinel_service_name = mymaster {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.socket_timeout = 0.1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.trace_requests = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler.trace_sqlalchemy = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler_jaeger.process_tags = {} {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler_jaeger.service_name_prefix = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] profiler_otlp.service_name_prefix = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.enforce_new_defaults = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.policy_default_rule = default {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.policy_file = policy.yaml {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.group = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.helper_command = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] privsep_osbrick.user = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.group = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.helper_command = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] cinder_sys_admin.user = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.auth_section = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.auth_type = password {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.cafile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.collect_timing = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.send_service_user_token = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.split_loggers = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.tls_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] service_user.tls_min_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.auth_section = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.auth_type = password {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.collect_timing = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.region_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.split_loggers = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.tls_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] glance.tls_min_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.backend_availability_zone = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.chap_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.chap_username = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.disk_geometry = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_client_cert = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_client_cert_key = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_data_namespace = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.driver_use_ssl = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.extra_capabilities = {} {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.filter_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.goodness_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iscsi_target_flags = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iscsi_write_cache = on {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iser_helper = tgtadm {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iser_port = 3260 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_host = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_login = admin {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_mount_options = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_private_key = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_share_path = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.num_shell_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.quobyte_volume_url = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.replication_device = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.report_discard_supported = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.reserved_percentage = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_helper = tgtadm {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_port = 3260 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_protocol = iscsi {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.trace_flags = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.unique_fqdn_network = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.use_chap_auth = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_backend_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_clear = zero {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_clear_ionice = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_clear_size = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_reports.file_event_handler = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_reports.log_dir = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.backend_availability_zone = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.backend_host = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.chap_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.chap_username = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.chiscsi_conf = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.disk_geometry = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_client_cert = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_data_namespace = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.driver_use_ssl = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.extra_capabilities = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.filter_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.goodness_function = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iser_helper = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iser_ip_address = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iser_port = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.iser_target_prefix = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_host = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_login = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_mount_options = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_password = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_private_key = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_share_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_ssh_port = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86387]: INFO cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 ... Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 -c /etc/quobyte/client-cinder.cfg {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.num_shell_tries = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.nvmet_port_id = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.replication_device = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.report_discard_supported = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.reserved_percentage = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.scst_target_driver = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.storage_protocol = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_helper = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_ip_address = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_port = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_prefix = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_protocol = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.trace_flags = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.use_chap_auth = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_clear = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_clear_size = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] QuobyteHD.volumes_dir = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_notifications.driver = [] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_notifications.retry = -1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] key_manager.fixed_key = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.barbican_api_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.barbican_endpoint = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.barbican_endpoint_type = public {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.barbican_region_name = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.cafile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 -c /etc/quobyte/client-cinder.cfg Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.collect_timing = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.number_of_retries = 60 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.retry_delay = 1 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.send_service_user_token = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.split_loggers = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.tls_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.tls_min_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.verify_ssl = True {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican.verify_ssl_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.auth_section = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.auth_type = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.cafile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.certfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.collect_timing = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.insecure = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.keyfile = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.split_loggers = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.timeout = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.tls_ciphers = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] barbican_service_user.tls_min_version = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.approle_role_id = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.approle_secret_id = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.auth_method = approle {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.auth_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.kv_mountpoint = secret {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.kv_path = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.kv_version = 2 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.namespace = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.root_token_id = **** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.ssl_ca_crt_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.timeout = 60.0 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.token_file = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.token_role = None {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.use_ssl = False {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:22 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] ******************************************************************************** {{(pid=86160) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 17:17:22 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.480s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:22 devstack cinder-volume[86387]: INFO cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 succeeded Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.499s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:22 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:22 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:22 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.256s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:22 devstack cinder-volume[86387]: INFO cinder.volume.driver [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG cinder.volume.driver [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5323219299316, 'free_capacity_gb': 1773.5323219299316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86387) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG oslo_db.sqlalchemy.engines [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG dbcounter [-] [86387] Writer thread running {{(pid=86387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG cinder.db.api [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Building query based on filter {{(pid=86387) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 17:17:22 devstack cinder-volume[86387]: DEBUG cinder.image.image_utils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86387) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 17:17:22 devstack cinder-volume[86387]: INFO cinder.keymgr.migration [None req-7fd5379a-250a-4b95-b2b8-c6c9ccb0c091 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:23 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:23 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:23 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.255s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Notifying Schedulers of capabilities ... {{(pid=86387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:23 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Driver initialization completed successfully. Nov 03 17:17:23 devstack cinder-volume[86387]: INFO cinder.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Initiating service 3 cleanup Nov 03 17:17:23 devstack cinder-volume[86387]: INFO cinder.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Service 3 cleanup completed. Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.service [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Creating RPC server for service cinder-volume {{(pid=86387) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.service [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86387) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 17:17:23 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:23 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:23 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:23 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:23 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.267s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:23 devstack cinder-volume[86387]: INFO cinder.volume.manager [None req-fa561f94-39f7-44f3-be03-3a1e7a3d83f5 None None] Driver post RPC initialization completed successfully. Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG cinder.volume.drivers.quobyte [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:28 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:28 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:28 devstack cinder-volume[86160]: INFO oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Caught SIGTERM, stopping children Nov 03 17:17:28 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Acquiring lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:28 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Acquired lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:28 devstack cinder-volume[86160]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Releasing lock "singleton_lock" {{(pid=86160) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:28 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Stop services. {{(pid=86160) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 17:17:28 devstack cinder-volume[86160]: DEBUG oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Killing children. {{(pid=86160) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 17:17:28 devstack cinder-volume[86160]: INFO oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Waiting on 1 children to exit Nov 03 17:17:28 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG oslo_concurrency.processutils [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.572s {{(pid=86387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:28 devstack cinder-volume[86387]: DEBUG cinder.manager [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Notifying Schedulers of capabilities ... {{(pid=86387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:28 devstack cinder-volume[86387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Unable to connect to AMQP server on 192.168.122.123:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server [None req-bc1431f3-f27e-43ef-b50d-306a42097e55 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.123:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server method() Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return _publish( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server listener(*args) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.123:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 03 17:17:29 devstack cinder-volume[86387]: ERROR oslo_messaging.rpc.server Nov 03 17:17:31 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Acquiring lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:31 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Acquired lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:31 devstack cinder-volume[86387]: DEBUG oslo_concurrency.lockutils [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Releasing lock "singleton_lock" {{(pid=86387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:31 devstack cinder-volume[86387]: WARNING amqp [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 17:17:31 devstack cinder-volume[86387]: WARNING amqp [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 17:17:31 devstack cinder-volume[86160]: INFO oslo_service.backend._eventlet.service [None req-06ebe682-3040-4697-9885-cbbbf718f171 None None] Child 86387 exited with status 0 Nov 03 17:17:32 devstack cinder-volume[86697]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 17:17:32 devstack cinder-volume[86697]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 17:17:32 devstack cinder-volume[86697]: we strongly recommend against using it for new projects. Nov 03 17:17:32 devstack cinder-volume[86697]: If you are already using Eventlet, we recommend migrating to a different Nov 03 17:17:32 devstack cinder-volume[86697]: framework. For more detail see Nov 03 17:17:32 devstack cinder-volume[86697]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 17:17:32 devstack cinder-volume[86697]: import eventlet # noqa Nov 03 17:17:35 devstack cinder-volume[86697]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 17:17:35 devstack cinder-volume[86697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 17:17:35 devstack cinder-volume[86697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 17:17:36 devstack cinder-volume[86697]: INFO dbcounter [None req-777199da-c584-454a-ac0c-113bce396baf None None] Registered counter for database cinder Nov 03 17:17:36 devstack cinder-volume[86697]: DEBUG oslo_db.sqlalchemy.engines [None req-777199da-c584-454a-ac0c-113bce396baf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:36 devstack cinder-volume[86697]: DEBUG dbcounter [-] [86697] Writer thread running {{(pid=86697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:17:36 devstack cinder-volume[86697]: INFO cinder.rpc [None req-777199da-c584-454a-ac0c-113bce396baf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 17:17:36 devstack cinder-volume[86697]: INFO cinder.rpc [None req-777199da-c584-454a-ac0c-113bce396baf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_db.sqlalchemy.engines [None req-777199da-c584-454a-ac0c-113bce396baf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:37 devstack cinder-volume[86697]: INFO cinder.volume.manager [None req-777199da-c584-454a-ac0c-113bce396baf None None] Determined volume DB was empty at startup. Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG cinder.volume.manager [None req-777199da-c584-454a-ac0c-113bce396baf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86697) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 17:17:37 devstack cinder-volume[86697]: WARNING stevedore.named [None req-777199da-c584-454a-ac0c-113bce396baf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 17:17:37 devstack cinder-volume[86697]: WARNING castellan.key_manager [None req-777199da-c584-454a-ac0c-113bce396baf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:17:37 devstack cinder-volume[86697]: WARNING cinder.keymgr.conf_key_mgr [None req-777199da-c584-454a-ac0c-113bce396baf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 17:17:37 devstack cinder-volume[86697]: INFO cinder.volume.manager [None req-777199da-c584-454a-ac0c-113bce396baf None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_db.sqlalchemy.engines [None req-777199da-c584-454a-ac0c-113bce396baf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:37 devstack cinder-volume[86697]: INFO oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] Starting 1 workers Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] Started child 86995 {{(pid=86697) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] Full set of CONF: {{(pid=86697) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] ******************************************************************************** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] Configuration options gathered from: {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] ================================================================================ {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] allow_availability_zone_fallback = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86995]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] allow_compression_on_image_upload = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] allowed_direct_url_schemes = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] api_rate_limit = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] auth_strategy = keystone {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_availability_zone = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_host = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_stats_polling_interval = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backup_api_class = cinder.backup.api.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backup_name_template = backup-%s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backup_use_same_host = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backup_use_temp_snapshot = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] chap_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] chap_username = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_internal_tenant_project_id = 2aa17b5401f640d8b3fd10448f916ffe {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_internal_tenant_user_id = e3ae005260844a8d9522424bc094b326 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cluster = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] compression_format = gzip {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] compute_api_class = cinder.compute.nova.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] config_dir = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] config_source = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] control_exchange = openstack {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] debug = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] default_availability_zone = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] default_group_type = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] default_volume_type = QuobyteHD {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] disk_geometry = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_client_cert = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_client_cert_key = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_data_namespace = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_ssl_cert_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_ssl_cert_verify = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] driver_use_ssl = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] enable_new_services = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] enable_unsupported_driver = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] enabled_backends = ['QuobyteHD'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] enforce_multipath_for_image_xfer = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] filter_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_api_insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_api_servers = ['http://192.168.122.123/image'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_api_ssl_compression = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_ca_certificates_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_catalog_info = image:glance:publicURL {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_num_retries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance_request_timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] goodness_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] graceful_shutdown_timeout = 5 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] group_api_class = cinder.group.api.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] host = devstack {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_compress_on_upload = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_conversion_address_space_limit = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_conversion_cpu_limit = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_conversion_disable = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_introspection_address_space_limit = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_introspection_cpu_limit = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_upload_use_cinder_backend = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_upload_use_internal_tenant = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_volume_cache_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_volume_cache_max_count = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] image_volume_cache_max_size_gb = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] init_host_max_objects_retrieval = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] instance_format = [instance: %(uuid)s] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iscsi_target_flags = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iscsi_write_cache = on {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iser_helper = tgtadm {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iser_ip_address = 192.168.122.123 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iser_port = 3260 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_color = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_config_append = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_dir = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_options = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_rotate_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_rotate_interval_type = days {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] log_rotation_type = none {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] max_age = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] max_logfile_count = 30 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] max_logfile_size_mb = 200 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] max_over_subscription_ratio = 20.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] message_reap_interval = 86400 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] message_ttl = 2592000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] migration_create_volume_timeout_secs = 300 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] monkey_patch = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] monkey_patch_modules = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] my_ip = 192.168.122.123 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] no_snapshot_gb_quota = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] num_iser_scan_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] num_shell_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] num_volume_device_scan_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] nvmeof_conn_info_version = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] nvmet_ns_id = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] nvmet_port_id = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_max_limit = 1000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_ext_list = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_listen = 0.0.0.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_listen_port = 8776 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_use_ssl = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] osapi_volume_workers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] per_volume_size_limit = -1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] periodic_fuzzy_delay = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] periodic_interval = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] project_id_regex = [0-9a-f\-]+ {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] public_endpoint = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] publish_errors = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_backup_gigabytes = 1000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_backups = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_gigabytes = 1000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_groups = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_snapshots = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] quota_volumes = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] rate_limit_burst = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] rate_limit_except_level = CRITICAL {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] rate_limit_interval = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] reinit_driver_count = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] replication_device = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] report_discard_supported = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] report_interval = 120 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] reservation_clean_interval = 86400 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] reservation_expire = 86400 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] reserved_image_namespaces = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] reserved_percentage = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] rpc_response_timeout = 120 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] run_external_periodic_tasks = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] scst_target_driver = iscsi {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] scst_target_iqn_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_down_time = 720 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] shell_completion = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] snapshot_name_template = snapshot-%s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] split_loggers = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] state_path = /opt/stack/data/cinder {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] storage_availability_zone = nova {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] storage_protocol = iSCSI {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] syslog_log_facility = LOG_USER {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_helper = lioadm {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_ip_address = 192.168.122.123 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_port = 3260 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_protocol = iscsi {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] target_secondary_ip_addresses = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] trace_flags = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] transfer_api_class = cinder.transfer.api.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] transport_url = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] until_refresh = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86995) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_chap_auth = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_default_quota_class = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_journal = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_json = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_multipath_for_image_xfer = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_stderr = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] use_syslog = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] verify_glance_signatures = enabled {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_api_class = cinder.volume.api.API {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_backend_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_clear = zero {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_clear_ionice = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_clear_size = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_copy_bps_limit = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_dd_blocksize = 1M {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_name_template = volume-%s {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_service_inithost_offload = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volume_usage_audit_period = month {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] zoning_mode = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_concurrency.disable_process_locking = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.auth_section = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.auth_type = password {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.auth_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.cache = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.delay_auth_decision = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.http_connect_timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.include_service_catalog = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.interface = public {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcache_username = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.region_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.service_token_roles_required = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.service_type = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.token_cache_time = 300 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.backend = dogpile.cache.null {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.backend_argument = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.backend_expiration_time = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.config_prefix = cache.oslo {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.debug_cache_backend = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.enable_retry_client = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.enable_socket_keepalive = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.expiration_time = 600 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.hashclient_retry_attempts = 2 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_dead_retry = 300 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_pool_maxsize = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_sasl_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.proxies = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.redis_db = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.redis_sentinel_service_name = mymaster {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.redis_server = localhost:6379 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.retry_attempts = 2 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.retry_delay = 0.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.socket_keepalive_count = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.socket_keepalive_idle = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.socket_keepalive_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.socket_timeout = 1.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.tls_allowed_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.tls_cafile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.tls_certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.tls_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.tls_keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cache.username = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] coordination.backend_url = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.asyncio_connection = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.asyncio_slave_connection = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.backend = sqlalchemy {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.connection = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.connection_debug = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.connection_parameters = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.connection_recycle_time = 3600 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.connection_trace = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.db_inc_retry_interval = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.db_max_retries = 20 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.db_max_retry_interval = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.db_retry_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.max_overflow = 50 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.max_pool_size = 5 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.max_retries = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.mysql_wsrep_sync_wait = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.pool_timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.retry_interval = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.slave_connection = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.sqlite_synchronous = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.synchronous_reader = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] database.use_db_reconnect = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86995) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 17:17:37 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 17:17:37 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_tracing.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.connection_string = messaging:// {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Running cmd (subprocess): mount.quobyte {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.es_doc_type = notification {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.es_scroll_size = 10000 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.es_scroll_time = 2m {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.filter_error_trace = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.hmac_keys = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.sentinel_service_name = mymaster {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.socket_timeout = 0.1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.trace_requests = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler.trace_sqlalchemy = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler_jaeger.process_tags = {} {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler_jaeger.service_name_prefix = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] profiler_otlp.service_name_prefix = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.enforce_new_defaults = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.policy_default_rule = default {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.policy_file = policy.yaml {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_policy.remote_timeout = 60.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.group = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.helper_command = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] privsep_osbrick.user = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.group = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.helper_command = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] cinder_sys_admin.user = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.auth_section = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.auth_type = password {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.cafile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.collect_timing = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.send_service_user_token = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.split_loggers = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.tls_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] service_user.tls_min_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.auth_section = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.auth_type = password {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.collect_timing = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.region_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.split_loggers = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.tls_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] glance.tls_min_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.backend_availability_zone = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.chap_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.chap_username = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.disk_geometry = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_client_cert = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_client_cert_key = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_data_namespace = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.driver_use_ssl = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.enable_unsupported_driver = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.extra_capabilities = {} {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.filter_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.goodness_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iscsi_target_flags = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iscsi_write_cache = on {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iser_helper = tgtadm {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iser_port = 3260 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_host = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_login = admin {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_mount_options = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_private_key = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_share_path = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_ssh_port = 22 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.num_shell_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.nvmet_port_id = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_client_cfg = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.quobyte_volume_url = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.replication_device = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.report_discard_supported = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.reserved_percentage = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.scst_target_driver = iscsi {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.scst_target_iqn_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.storage_protocol = iSCSI {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_helper = tgtadm {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_port = 3260 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_protocol = iscsi {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.trace_flags = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.unique_fqdn_network = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.use_chap_auth = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_backend_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_clear = zero {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_clear_ionice = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_clear_size = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_reports.file_event_handler = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_reports.log_dir = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.backend_availability_zone = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.backend_host = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.chap_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.chap_username = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.chiscsi_conf = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.disk_geometry = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_client_cert = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_client_cert_key = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_data_namespace = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.driver_use_ssl = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.extra_capabilities = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.filter_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.goodness_function = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iscsi_target_flags = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iscsi_write_cache = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iser_helper = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iser_ip_address = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iser_port = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.iser_target_prefix = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_host = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_login = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_mount_options = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_password = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_private_key = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_share_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_ssh_port = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.num_shell_tries = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nvmet_ns_id = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.nvmet_port_id = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.replication_device = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.report_discard_supported = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.reserved_percentage = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.scst_target_driver = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.storage_protocol = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_helper = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_ip_address = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_port = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_prefix = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_protocol = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.trace_flags = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.unique_fqdn_network = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.use_chap_auth = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_clear = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_clear_ionice = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_clear_size = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] QuobyteHD.volumes_dir = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.ssl_version = {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_notifications.driver = [] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_notifications.retry = -1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] oslo_messaging_notifications.transport_url = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] key_manager.fixed_key = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.barbican_api_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.barbican_endpoint = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.barbican_endpoint_type = public {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.barbican_region_name = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.cafile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.collect_timing = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.number_of_retries = 60 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.retry_delay = 1 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.send_service_user_token = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.split_loggers = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.tls_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.tls_min_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.verify_ssl = True {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican.verify_ssl_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.auth_section = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.auth_type = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.cafile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.certfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.collect_timing = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.insecure = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.keyfile = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.split_loggers = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.timeout = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.tls_ciphers = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] barbican_service_user.tls_min_version = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.approle_role_id = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.approle_secret_id = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.auth_method = approle {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.auth_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.kv_mountpoint = secret {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.kv_path = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.kv_version = 2 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.namespace = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.root_token_id = **** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.ssl_ca_crt_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.timeout = 60.0 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.token_file = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.token_role = None {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.use_ssl = False {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 17:17:37 devstack cinder-volume[86697]: DEBUG oslo_service.backend._eventlet.service [None req-777199da-c584-454a-ac0c-113bce396baf None None] ******************************************************************************** {{(pid=86697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 17:17:37 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.336s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:37 devstack cinder-volume[86995]: INFO cinder.volume.driver [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 17:17:37 devstack cinder-volume[86995]: DEBUG cinder.volume.driver [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5546951293945, 'free_capacity_gb': 1773.5546951293945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86995) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_db.sqlalchemy.engines [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writer thread running {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.db.api [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Building query based on filter {{(pid=86995) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86995) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.keymgr.migration [None req-aa75e5db-ebf3-49f6-b505-894b8bad6492 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 17:17:38 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:38 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:38 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.247s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Driver initialization completed successfully. Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Initiating service 3 cleanup Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Service 3 cleanup completed. Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.service [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Creating RPC server for service cinder-volume {{(pid=86995) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.service [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86995) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:38 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:17:38 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:38 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.242s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e6f52f85-1bb9-41d3-a49c-ba615fa8eaa9 None None] Driver post RPC initialization completed successfully. Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 6 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:17:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:17:47 devstack cinder-volume[86697]: DEBUG dbcounter [-] [86697] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:38 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:18:38 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:39 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:18:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 6 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:18:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Flow 'volume_create_manager' (4e8d33c5-7245-446c-98aa-20c17c52e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc7fc15-4c43-4b54-b355-5c288775419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc7fc15-4c43-4b54-b355-5c288775419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1041986355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df28e5-4f50-4f1e-96a7-91c611d545f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030709131983430c877ac6722768483b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:46Z,use_quota=True,user_id='1d83714f94374196bb92f9668d39f92a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59bb34d-ec38-4ba2-ae0e-b6976b3a1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59bb34d-ec38-4ba2-ae0e-b6976b3a1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e1d2c6-5f0f-4a1c-9ed6-221152621ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e1d2c6-5f0f-4a1c-9ed6-221152621ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65df28e5-4f50-4f1e-96a7-91c611d545f6', 'volume_name': 'volume-65df28e5-4f50-4f1e-96a7-91c611d545f6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5817bc13-1158-485e-8544-b3e68b389e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5817bc13-1158-485e-8544-b3e68b389e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce382cf8-7fe4-4e94-828d-da3cda3017b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Volume 65df28e5-4f50-4f1e-96a7-91c611d545f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65df28e5-4f50-4f1e-96a7-91c611d545f6', 'volume_size': 1} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1041986355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df28e5-4f50-4f1e-96a7-91c611d545f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030709131983430c877ac6722768483b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:46Z,use_quota=True,user_id='1d83714f94374196bb92f9668d39f92a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Creating volume 65df28e5-4f50-4f1e-96a7-91c611d545f6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:46 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:18:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:46 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 1073741824 Nov 03 17:18:46 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 1073741824" returned: 0 in 0.723s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:47 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:47 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 Nov 03 17:18:47 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:47 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6" returned: 0 in 0.356s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce382cf8-7fe4-4e94-828d-da3cda3017b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65df28e5-4f50-4f1e-96a7-91c611d545f6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec35f4b7-3db9-4ad6-8190-1378bacd0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Volume volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 (65df28e5-4f50-4f1e-96a7-91c611d545f6): created successfully Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec35f4b7-3db9-4ad6-8190-1378bacd0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Flow 'volume_create_manager' (4e8d33c5-7245-446c-98aa-20c17c52e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bde13762-70db-4a51-9452-636c65b4638b tempest-TaggedAttachmentsTest-937083490 None] Created volume successfully. Nov 03 17:18:57 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:57 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Flow 'volume_create_manager' (5d993343-9d44-48b7-b013-5ce2444a983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b10c70-cab3-42d0-be37-fc1aa0ed9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b10c70-cab3-42d0-be37-fc1aa0ed9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1684096904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7749d796-c13e-44c8-81c4-5ad0de7aedbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900441467a1a40c881219e671c0c0630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:10Z,use_quota=True,user_id='9519e7535a5b4464ad878c65cf182189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d4c2fb-99d0-44bb-9489-155317734216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d4c2fb-99d0-44bb-9489-155317734216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdd26c4-ed15-4a85-a709-4804e79bd1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdd26c4-ed15-4a85-a709-4804e79bd1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7749d796-c13e-44c8-81c4-5ad0de7aedbc', 'volume_name': 'volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177f2719-120d-4884-aa5a-64c2c0c177f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177f2719-120d-4884-aa5a-64c2c0c177f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65299a-194a-43d1-8ad9-cbf0f2978cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:10 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Volume 7749d796-c13e-44c8-81c4-5ad0de7aedbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc', 'volume_size': 1} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1684096904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7749d796-c13e-44c8-81c4-5ad0de7aedbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900441467a1a40c881219e671c0c0630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:10Z,use_quota=True,user_id='9519e7535a5b4464ad878c65cf182189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Creating volume 7749d796-c13e-44c8-81c4-5ad0de7aedbc {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:10 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:19:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:10 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc 1073741824 Nov 03 17:19:10 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:11 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc 1073741824" returned: 0 in 1.199s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:11 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc Nov 03 17:19:11 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc" returned: 0 in 0.645s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:12 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65299a-194a-43d1-8ad9-cbf0f2978cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22f5d0d-cdd9-40cc-b6bf-bd0aa0ada7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:12 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Volume volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc (7749d796-c13e-44c8-81c4-5ad0de7aedbc): created successfully Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22f5d0d-cdd9-40cc-b6bf-bd0aa0ada7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Flow 'volume_create_manager' (5d993343-9d44-48b7-b013-5ce2444a983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-112e4b27-1f00-490e-b2e4-f39623a6cfc5 tempest-DeleteServersTestJSON-983798505 None] Created volume successfully. Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Flow 'volume_create_manager' (ac1ff6b5-151f-4d4c-b981-54c6abbc61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5992e9be-91df-4fd7-9d6e-f903962fc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5992e9be-91df-4fd7-9d6e-f903962fc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1261742413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1596383-2199-46cb-b1a0-51133f0a9696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8b363b835e4fd097034353f47a7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:18Z,use_quota=True,user_id='1d86b0d568514b0d938c21cfff7350bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfaa81b-09c7-49bd-b473-81efab5e12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfaa81b-09c7-49bd-b473-81efab5e12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148e9da4-95d4-4851-9565-55fc66cf929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148e9da4-95d4-4851-9565-55fc66cf929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1596383-2199-46cb-b1a0-51133f0a9696', 'volume_name': 'volume-b1596383-2199-46cb-b1a0-51133f0a9696', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e981d412-4fde-4ca2-9a2c-00e4f7d00d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e981d412-4fde-4ca2-9a2c-00e4f7d00d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e2fa10-f538-42c5-9f91-4332339eaa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Volume b1596383-2199-46cb-b1a0-51133f0a9696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1596383-2199-46cb-b1a0-51133f0a9696', 'volume_size': 1} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1261742413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1596383-2199-46cb-b1a0-51133f0a9696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8b363b835e4fd097034353f47a7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:18Z,use_quota=True,user_id='1d86b0d568514b0d938c21cfff7350bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Creating volume b1596383-2199-46cb-b1a0-51133f0a9696 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:18 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:19:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:18 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 1073741824 Nov 03 17:19:18 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:19 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 1073741824" returned: 0 in 1.259s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:19 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 Nov 03 17:19:19 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:20 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696" returned: 0 in 0.948s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e2fa10-f538-42c5-9f91-4332339eaa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1596383-2199-46cb-b1a0-51133f0a9696', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7793f51-98a3-4f12-a3eb-5fe089f64af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Volume volume-b1596383-2199-46cb-b1a0-51133f0a9696 (b1596383-2199-46cb-b1a0-51133f0a9696): created successfully Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7793f51-98a3-4f12-a3eb-5fe089f64af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Flow 'volume_create_manager' (ac1ff6b5-151f-4d4c-b981-54c6abbc61c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-078e9dc9-80e4-4008-ac18-93cceb7d0de4 tempest-VolumesAdminNegativeTest-1432052382 None] Created volume successfully. Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Acquiring lock "cinder-b1596383-2199-46cb-b1a0-51133f0a9696-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "cinder-b1596383-2199-46cb-b1a0-51133f0a9696-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Acquiring lock "cinder-quobyte-b1596383-2199-46cb-b1a0-51133f0a9696" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "cinder-quobyte-b1596383-2199-46cb-b1a0-51133f0a9696" acquired by "delete_volume" :: waited 0.054s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:22 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf3iadbk8/privsep.sock'] Nov 03 17:19:22 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf3iadbk8/privsep.sock Nov 03 17:19:22 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:22 devstack cinder-volume[86995]: WARNING py.warnings [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 17:19:22 devstack cinder-volume[86995]: .first() Nov 03 17:19:22 devstack cinder-volume[86995]: Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c824b979-34ba-4b81-bc47-7abeb583d95a', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:19:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-f3a7c19d-d24f-499c-95da-c7d1a92ed056 req-3b0bd1ee-18f5-4fff-93e6-d1ae6861e1f0 tempest-DeleteServersTestJSON-983798505 None] attachment_update completed successfully. Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 17:19:24 devstack cinder-volume[86995]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 17:19:24 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:24 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Spawned new privsep daemon via rootwrap Nov 03 17:19:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Accepted privsep connection to /tmp/tmpf3iadbk8/privsep.sock {{(pid=86995) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 17:19:24 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 17:19:24 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 17:19:24 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 17:19:24 devstack cinder-volume[86995]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88199 Nov 03 17:19:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[68208eb7-a03c-4308-bbb7-ae73fa3064ac]: (2,) {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9978c60-77ab-4197-8ba9-b3328117bd5f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:25 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 Nov 03 17:19:25 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:26 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696" returned: 0 in 1.309s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:26 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696 Nov 03 17:19:26 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:26 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1596383-2199-46cb-b1a0-51133f0a9696" returned: 0 in 0.680s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "cinder-quobyte-b1596383-2199-46cb-b1a0-51133f0a9696" released by "delete_volume" :: held 4.341s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:26 devstack cinder-volume[86995]: WARNING cinder.quota [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:19:26 devstack cinder-volume[86995]: WARNING cinder.quota [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:19:26 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Created reservations ['965e6038-5092-4b2e-977b-6ee12468d011', 'e75a335d-7294-4d68-a857-671d921b5edd', '2b8dd346-d4d1-47d1-8622-5caa2abee130', 'd7634640-2ed8-4df1-ad63-abff5b1a06e3'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:27 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:19:27 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:27 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.737s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:27 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Deleted volume successfully. Nov 03 17:19:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-edc75a1d-17ba-4607-bee6-bcd25ace1088 tempest-VolumesAdminNegativeTest-1432052382 None] Lock "cinder-b1596383-2199-46cb-b1a0-51133f0a9696-delete_volume" released by "delete_volume" :: held 5.748s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-c610bbdd-8453-4ef5-89f7-6a55ef157cc7 req-6f8764f8-4f89-4c47-8098-47d593ab095b tempest-DeleteServersTestJSON-983798505 None] Terminate volume connection completed successfully. Nov 03 17:19:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-c610bbdd-8453-4ef5-89f7-6a55ef157cc7 req-6f8764f8-4f89-4c47-8098-47d593ab095b tempest-DeleteServersTestJSON-983798505 None] Deleting attachment c824b979-34ba-4b81-bc47-7abeb583d95a. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "cinder-7749d796-c13e-44c8-81c4-5ad0de7aedbc-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "cinder-7749d796-c13e-44c8-81c4-5ad0de7aedbc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "cinder-quobyte-7749d796-c13e-44c8-81c4-5ad0de7aedbc" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "cinder-quobyte-7749d796-c13e-44c8-81c4-5ad0de7aedbc" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a5f0f-f7b3-488c-9b28-7430ba6793b6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:33 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc Nov 03 17:19:33 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:34 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc" returned: 0 in 0.626s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:34 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc Nov 03 17:19:34 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:34 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7749d796-c13e-44c8-81c4-5ad0de7aedbc" returned: 0 in 0.462s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "cinder-quobyte-7749d796-c13e-44c8-81c4-5ad0de7aedbc" released by "delete_volume" :: held 1.210s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Created reservations ['b541a2a3-7861-4d53-a206-869d3127b6b6', '8ebc694a-18ea-4dc4-8621-f58e7365df5c', 'cd8ab461-8e01-448e-845f-60b203183cf1', '1fab9a59-ef27-43e7-9cc5-63ecc31cee2b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:34 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:19:34 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:35 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.320s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:35 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Deleted volume successfully. Nov 03 17:19:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d3b27930-0010-4cd2-a350-3b34b7827fd3 tempest-DeleteServersTestJSON-983798505 None] Lock "cinder-7749d796-c13e-44c8-81c4-5ad0de7aedbc-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:38 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:19:38 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.345s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:19:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db72fede-e09e-4fbf-941f-e9d8856aa138 req-0f95c707-116d-4e26-a98c-4db288477c79 tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db72fede-e09e-4fbf-941f-e9d8856aa138 req-0f95c707-116d-4e26-a98c-4db288477c79 tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db72fede-e09e-4fbf-941f-e9d8856aa138 req-0f95c707-116d-4e26-a98c-4db288477c79 tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-db72fede-e09e-4fbf-941f-e9d8856aa138 req-0f95c707-116d-4e26-a98c-4db288477c79 tempest-TaggedAttachmentsTest-937083490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-65df28e5-4f50-4f1e-96a7-91c611d545f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bd4a8db-13a4-4f3c-bab4-31417b502bd7', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:20:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-db72fede-e09e-4fbf-941f-e9d8856aa138 req-0f95c707-116d-4e26-a98c-4db288477c79 tempest-TaggedAttachmentsTest-937083490 None] attachment_update completed successfully. Nov 03 17:20:13 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-6ebe10f9-2ee7-40fe-a987-f28002a3c635 req-f9b5a4aa-c5c3-4526-82f7-5966b833dd77 tempest-TaggedAttachmentsTest-937083490 None] Terminate volume connection completed successfully. Nov 03 17:20:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-6ebe10f9-2ee7-40fe-a987-f28002a3c635 req-f9b5a4aa-c5c3-4526-82f7-5966b833dd77 tempest-TaggedAttachmentsTest-937083490 None] Deleting attachment 3bd4a8db-13a4-4f3c-bab4-31417b502bd7. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:20:23 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:23 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:38 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:20:38 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:39 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.541s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:20:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 8 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:20:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "cinder-65df28e5-4f50-4f1e-96a7-91c611d545f6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "cinder-65df28e5-4f50-4f1e-96a7-91c611d545f6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "cinder-quobyte-65df28e5-4f50-4f1e-96a7-91c611d545f6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "cinder-quobyte-65df28e5-4f50-4f1e-96a7-91c611d545f6" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[500af55f-8ca7-4ae9-9ccc-976bdfb0958c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:43 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 Nov 03 17:20:43 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:44 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6" returned: 0 in 0.825s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6 Nov 03 17:20:44 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-65df28e5-4f50-4f1e-96a7-91c611d545f6" returned: 0 in 0.582s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "cinder-quobyte-65df28e5-4f50-4f1e-96a7-91c611d545f6" released by "delete_volume" :: held 1.480s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Created reservations ['cba36c55-8ab8-4fc2-bca1-d45fd81fcad0', '16ee0781-86b3-4e55-b87d-2d778344cac7', '4212c60f-a5d4-4802-9e79-07de3a2edfac', '9608e8f0-05f3-48bf-873d-27be9e2b1d4f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:45 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:20:45 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.486s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Deleted volume successfully. Nov 03 17:20:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9278e32e-a493-4967-b3c7-f130aa1da532 tempest-TaggedAttachmentsTest-937083490 None] Lock "cinder-65df28e5-4f50-4f1e-96a7-91c611d545f6-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:59 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Flow 'volume_create_manager' (b0623223-7638-4d6e-ab77-93b1bd89b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71be452d-da3c-48c2-9733-a68900dd60ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71be452d-da3c-48c2-9733-a68900dd60ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-233845185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e3e905-929c-4c00-9f74-da81f2e0e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30b1d00a374635bbaa5bf3a7e31598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:00Z,use_quota=True,user_id='aa56bbfa88a449ab8e696bc29898a0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dd5c7e-c874-41e8-8286-16c5172ef8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dd5c7e-c874-41e8-8286-16c5172ef8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870d6c24-00f7-44e5-863d-ae70a19e50af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870d6c24-00f7-44e5-863d-ae70a19e50af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e3e905-929c-4c00-9f74-da81f2e0e395', 'volume_name': 'volume-a1e3e905-929c-4c00-9f74-da81f2e0e395', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dc3d45-92e2-41de-9083-79144e37dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dc3d45-92e2-41de-9083-79144e37dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5433f7-d966-4c5f-a581-06a4e1fda892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:00 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Volume a1e3e905-929c-4c00-9f74-da81f2e0e395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e3e905-929c-4c00-9f74-da81f2e0e395', 'volume_size': 1} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-233845185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e3e905-929c-4c00-9f74-da81f2e0e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30b1d00a374635bbaa5bf3a7e31598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:00Z,use_quota=True,user_id='aa56bbfa88a449ab8e696bc29898a0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Creating volume a1e3e905-929c-4c00-9f74-da81f2e0e395 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:00 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:21:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:00 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 1073741824 Nov 03 17:21:00 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 1073741824" returned: 0 in 1.129s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:01 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 Nov 03 17:21:01 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395" returned: 0 in 0.475s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5433f7-d966-4c5f-a581-06a4e1fda892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e3e905-929c-4c00-9f74-da81f2e0e395', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3360a1-389b-428b-948f-e1f625d85213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:01 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Volume volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 (a1e3e905-929c-4c00-9f74-da81f2e0e395): created successfully Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3360a1-389b-428b-948f-e1f625d85213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Flow 'volume_create_manager' (b0623223-7638-4d6e-ab77-93b1bd89b763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d5fe5385-03ec-4779-89f4-e7065e9c85f3 tempest-ServerActionsTestOtherA-1577599008 None] Created volume successfully. Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Flow 'volume_create_manager' (2a37b810-fb83-4057-be11-607546654190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8350f9-0dd7-43e5-bacf-2a2f4554fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8350f9-0dd7-43e5-bacf-2a2f4554fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-842713165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f172c-a256-4670-ae88-d356b72c0e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d7ad99b10c44489a00c03f1f83a872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:06Z,use_quota=True,user_id='80b5254e398745288d44fe256392d4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647d397-33b9-40ff-bf07-c90dc196b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647d397-33b9-40ff-bf07-c90dc196b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b470b0-44e9-43ec-93d9-7f3ced34e06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b470b0-44e9-43ec-93d9-7f3ced34e06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0f172c-a256-4670-ae88-d356b72c0e57', 'volume_name': 'volume-3f0f172c-a256-4670-ae88-d356b72c0e57', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e0303f-b44f-420b-8e6a-442c2c6b2952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e0303f-b44f-420b-8e6a-442c2c6b2952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e4cb0f-a8ef-4d0d-a745-034c09f29452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Volume 3f0f172c-a256-4670-ae88-d356b72c0e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0f172c-a256-4670-ae88-d356b72c0e57', 'volume_size': 1} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-842713165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f172c-a256-4670-ae88-d356b72c0e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d7ad99b10c44489a00c03f1f83a872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:06Z,use_quota=True,user_id='80b5254e398745288d44fe256392d4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Creating volume 3f0f172c-a256-4670-ae88-d356b72c0e57 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:06 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:21:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:06 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 1073741824 Nov 03 17:21:06 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:07 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 1073741824" returned: 0 in 1.223s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:08 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 Nov 03 17:21:08 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:08 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57" returned: 0 in 0.634s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e4cb0f-a8ef-4d0d-a745-034c09f29452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0f172c-a256-4670-ae88-d356b72c0e57', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9959235-e4ff-4936-a4b8-6c1e2146d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Volume volume-3f0f172c-a256-4670-ae88-d356b72c0e57 (3f0f172c-a256-4670-ae88-d356b72c0e57): created successfully Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9959235-e4ff-4936-a4b8-6c1e2146d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Flow 'volume_create_manager' (2a37b810-fb83-4057-be11-607546654190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2c632568-31a8-4559-939d-9f9e1122d7f3 tempest-ServersNegativeTestJSON-1425882246 None] Created volume successfully. Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Flow 'volume_create_manager' (bacb7111-eef1-4141-872d-e21c471c8df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bc759d-7597-43af-a9a8-1db06ee39c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bc759d-7597-43af-a9a8-1db06ee39c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1328245642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0304b4-503b-4a9a-af93-bc78eda5ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d7ad99b10c44489a00c03f1f83a872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:13Z,use_quota=True,user_id='80b5254e398745288d44fe256392d4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9363f887-a2c8-4b30-8b60-fae9f1a02991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9363f887-a2c8-4b30-8b60-fae9f1a02991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393c718-e2f6-445e-b82b-3a608f478592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393c718-e2f6-445e-b82b-3a608f478592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0304b4-503b-4a9a-af93-bc78eda5ec48', 'volume_name': 'volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b57191-0519-4bb9-9a1f-08324495377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b57191-0519-4bb9-9a1f-08324495377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cb025a-65f0-4387-9f17-6f254c8a8099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:13 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Volume 2f0304b4-503b-4a9a-af93-bc78eda5ec48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48', 'volume_size': 1} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1328245642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0304b4-503b-4a9a-af93-bc78eda5ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d7ad99b10c44489a00c03f1f83a872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:13Z,use_quota=True,user_id='80b5254e398745288d44fe256392d4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Creating volume 2f0304b4-503b-4a9a-af93-bc78eda5ec48 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:13 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:21:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:13 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 1073741824 Nov 03 17:21:13 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:14 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 1073741824" returned: 0 in 0.994s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:14 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 Nov 03 17:21:14 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48" returned: 0 in 0.724s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Flow 'volume_create_manager' (bbb24e16-dda4-4091-af4f-3c4a26f1b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce3511d-c663-473c-af8d-0932bbce7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce3511d-c663-473c-af8d-0932bbce7554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-689087563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a58c04090442e2afb672483e358d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:15Z,use_quota=True,user_id='58a95d2fcf5f44e48520f1b42837cb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2cc42d-3053-4130-9299-23e947884e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2cc42d-3053-4130-9299-23e947884e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20c2704-412a-44d5-b8d7-78ecd8706bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20c2704-412a-44d5-b8d7-78ecd8706bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc', 'volume_name': 'volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259ba00-3d40-44ed-a714-d186e408679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259ba00-3d40-44ed-a714-d186e408679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25609d56-89d6-465f-a2e9-524ccb6f9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Volume 45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc', 'volume_size': 1} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-689087563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a58c04090442e2afb672483e358d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:15Z,use_quota=True,user_id='58a95d2fcf5f44e48520f1b42837cb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Creating volume 45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:15 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cb025a-65f0-4387-9f17-6f254c8a8099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a60997-c95f-426f-8a6e-e963f46f1236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Volume volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 (2f0304b4-503b-4a9a-af93-bc78eda5ec48): created successfully Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a60997-c95f-426f-8a6e-e963f46f1236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Flow 'volume_create_manager' (bacb7111-eef1-4141-872d-e21c471c8df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:15 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc 1073741824 Nov 03 17:21:15 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6032fb32-0f9b-4228-9dcf-62c942037c9e tempest-ServersNegativeTestJSON-1425882246 None] Created volume successfully. Nov 03 17:21:16 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc 1073741824" returned: 0 in 0.810s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc Nov 03 17:21:16 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:16 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" returned: 0 in 0.528s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25609d56-89d6-465f-a2e9-524ccb6f9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c4158a-ae43-4fa4-90d4-2e2da1d487b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Volume volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc (45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc): created successfully Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c4158a-ae43-4fa4-90d4-2e2da1d487b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Flow 'volume_create_manager' (bbb24e16-dda4-4091-af4f-3c4a26f1b971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a64345f1-581b-4d43-a4fb-189eba0ba7c5 tempest-ServerRescueNegativeTestJSON-1953757097 None] Created volume successfully. Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "cinder-2f0304b4-503b-4a9a-af93-bc78eda5ec48-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-2f0304b4-503b-4a9a-af93-bc78eda5ec48-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "cinder-quobyte-2f0304b4-503b-4a9a-af93-bc78eda5ec48" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-quobyte-2f0304b4-503b-4a9a-af93-bc78eda5ec48" acquired by "delete_volume" :: waited 0.045s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8e638-f23b-4e96-a8cb-e68ad5df6608]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:19 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 Nov 03 17:21:19 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:20 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48" returned: 0 in 1.058s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:20 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48 Nov 03 17:21:20 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:21 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2f0304b4-503b-4a9a-af93-bc78eda5ec48" returned: 0 in 1.022s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-quobyte-2f0304b4-503b-4a9a-af93-bc78eda5ec48" released by "delete_volume" :: held 2.278s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:21 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Created reservations ['7ba0499c-99ee-4e22-96ca-fc26d2031b13', 'e72604d6-b024-4f81-aa16-d963a2738575', '454e0255-fd00-486c-9c3c-2b2e2dde5c88', '6a0c72b8-c43f-4a54-806b-74e7c00b387a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:22 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:21:22 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:22 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.661s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Deleted volume successfully. Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-735bd719-4c9a-4972-9356-892a011389df tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-2f0304b4-503b-4a9a-af93-bc78eda5ec48-delete_volume" released by "delete_volume" :: held 3.666s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "cinder-3f0f172c-a256-4670-ae88-d356b72c0e57-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-3f0f172c-a256-4670-ae88-d356b72c0e57-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "cinder-quobyte-3f0f172c-a256-4670-ae88-d356b72c0e57" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-quobyte-3f0f172c-a256-4670-ae88-d356b72c0e57" acquired by "delete_volume" :: waited 0.043s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:23 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee76ec7-1518-49b9-a719-e1829d1ac305]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:23 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 Nov 03 17:21:23 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:24 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57" returned: 0 in 1.189s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:24 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57 Nov 03 17:21:24 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:24 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f0f172c-a256-4670-ae88-d356b72c0e57" returned: 0 in 0.559s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-quobyte-3f0f172c-a256-4670-ae88-d356b72c0e57" released by "delete_volume" :: held 1.890s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Created reservations ['1bc08d3c-11dc-4bae-90bc-d9386fe7a3e4', '5f9e8a20-a1f7-435e-ae2e-b0b8bc109c92', 'ca91cd33-5794-4612-ad3a-e50830ab45a9', '969cffdf-b64e-4313-9d20-10ca51c7e317'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:25 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:21:25 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:26 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 1.035s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:26 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Deleted volume successfully. Nov 03 17:21:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3aef451-4daf-428e-ad20-55dfa994311f tempest-ServersNegativeTestJSON-1425882246 None] Lock "cinder-3f0f172c-a256-4670-ae88-d356b72c0e57-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:35 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:36 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=16,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:38 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:21:38 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:39 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.538s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:21:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 8 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:21:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Acquiring lock "cinder-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "cinder-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Acquiring lock "cinder-quobyte-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "cinder-quobyte-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9065da8-0d58-43d5-983b-8f2fabc6e953]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:45 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc Nov 03 17:21:45 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:46 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" returned: 0 in 0.877s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:46 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc Nov 03 17:21:46 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:46 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" returned: 0 in 0.429s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "cinder-quobyte-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc" released by "delete_volume" :: held 1.408s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Created reservations ['15b1012d-615b-4b51-8dea-6558b6e08d22', '897b7ea2-d7fe-48eb-b123-d4a61d095e66', '337f0ebd-b375-4592-80ef-7c1de39a9c4f', 'fca0838a-8a45-4115-aa11-424365a1c7c9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:46 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:21:46 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:47 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.516s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:47 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Deleted volume successfully. Nov 03 17:21:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-886d47ff-eae9-4cda-8f4e-d5dcbda832a1 tempest-ServerRescueNegativeTestJSON-1953757097 None] Lock "cinder-45d7e6b7-e1bd-4a6e-8dbb-200a70e159bc-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:56 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-5fca3c08-1a7a-47d8-8fcb-9c8e74c45662 req-38180951-f5e8-44c4-915a-e0e19a1f3dd4 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-5fca3c08-1a7a-47d8-8fcb-9c8e74c45662 req-38180951-f5e8-44c4-915a-e0e19a1f3dd4 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-5fca3c08-1a7a-47d8-8fcb-9c8e74c45662 req-38180951-f5e8-44c4-915a-e0e19a1f3dd4 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-5fca3c08-1a7a-47d8-8fcb-9c8e74c45662 req-38180951-f5e8-44c4-915a-e0e19a1f3dd4 tempest-ServerActionsTestOtherA-1577599008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-a1e3e905-929c-4c00-9f74-da81f2e0e395', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24638be6-a5df-4f29-b39d-1f2a9dfb8f25', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:21:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-5fca3c08-1a7a-47d8-8fcb-9c8e74c45662 req-38180951-f5e8-44c4-915a-e0e19a1f3dd4 tempest-ServerActionsTestOtherA-1577599008 None] attachment_update completed successfully. Nov 03 17:22:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-27d25392-f425-4d14-9741-99c1993006fd tempest-ServerActionsTestOtherA-1577599008 None] Terminate volume connection completed successfully. Nov 03 17:22:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-27d25392-f425-4d14-9741-99c1993006fd tempest-ServerActionsTestOtherA-1577599008 None] Deleting attachment 24638be6-a5df-4f29-b39d-1f2a9dfb8f25. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:22:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-a7ee4ed0-e399-40ec-ac69-548f8f0ed047 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-a7ee4ed0-e399-40ec-ac69-548f8f0ed047 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-a7ee4ed0-e399-40ec-ac69-548f8f0ed047 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-a7ee4ed0-e399-40ec-ac69-548f8f0ed047 tempest-ServerActionsTestOtherA-1577599008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-a1e3e905-929c-4c00-9f74-da81f2e0e395', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32b75282-4ff3-449e-a2b0-0754f76300b3', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:22:05 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-d4846b20-cfd5-4f19-9bbd-1b03cd90556b req-a7ee4ed0-e399-40ec-ac69-548f8f0ed047 tempest-ServerActionsTestOtherA-1577599008 None] attachment_update completed successfully. Nov 03 17:22:15 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:22:15 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=11,cinder:SELECT=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:22:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-52b4aabf-a081-41ab-8cf6-b4055951386f tempest-GroupSnapshotsV319Test-412681627 None] Group tempest-GroupSnapshotsV319Test-Group-797554132: creating Nov 03 17:22:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-52b4aabf-a081-41ab-8cf6-b4055951386f tempest-GroupSnapshotsV319Test-412681627 None] Group tempest-GroupSnapshotsV319Test-Group-797554132: created successfully Nov 03 17:22:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-52b4aabf-a081-41ab-8cf6-b4055951386f tempest-GroupSnapshotsV319Test-412681627 None] Create group completed successfully. Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Flow 'volume_create_manager' (940baa8b-9fce-411d-8c5c-35fe52879488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8499bc7-aec5-4050-9e55-7ffe3e6eaf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8499bc7-aec5-4050-9e55-7ffe3e6eaf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302032178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b91cd287-0809-478e-8053-f0cec903006b,host='devstack@QuobyteHD#QuobyteHD',id=4a7478dc-bdc8-4f32-9e3c-af6f48dac951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864a216fdce74113a23a6c28f7461d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:20Z,use_quota=True,user_id='baa7c4011e534f6da737849b4b0aea42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e090d3f-8a6d-40e9-8302-6f7a43b80100),volume_type_id=4e090d3f-8a6d-40e9-8302-6f7a43b80100)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd5cfb-cdd9-4636-a4f7-db04ca8f5c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd5cfb-cdd9-4636-a4f7-db04ca8f5c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1721b63a-1252-4210-a8bc-78850bd4fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1721b63a-1252-4210-a8bc-78850bd4fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7478dc-bdc8-4f32-9e3c-af6f48dac951', 'volume_name': 'volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cced5c-0703-4b48-9fab-fe0f962af5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cced5c-0703-4b48-9fab-fe0f962af5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dd176d-8269-4c7f-bdfe-cd144070a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Volume 4a7478dc-bdc8-4f32-9e3c-af6f48dac951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951', 'volume_size': 1} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b91cd287-0809-478e-8053-f0cec903006b,created_at=2026-11-03T16:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302032178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b91cd287-0809-478e-8053-f0cec903006b,host='devstack@QuobyteHD#QuobyteHD',id=4a7478dc-bdc8-4f32-9e3c-af6f48dac951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864a216fdce74113a23a6c28f7461d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:20Z,use_quota=True,user_id='baa7c4011e534f6da737849b4b0aea42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e090d3f-8a6d-40e9-8302-6f7a43b80100),volume_type_id=4e090d3f-8a6d-40e9-8302-6f7a43b80100)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Creating volume 4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:20 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:20 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 1073741824 Nov 03 17:22:20 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Flow 'volume_create_manager' (d320f19e-94ee-40da-bd0b-b9ade4c8eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6537677-d7c7-4782-8558-3e68114e9102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6537677-d7c7-4782-8558-3e68114e9102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-144648515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a12aa4-5c19-4756-ac99-c4cf43465450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26aa3bd52d94016a7be80007a676d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:21Z,use_quota=True,user_id='39f741868b8942a3bc9253819e78df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02040365-cb47-49b9-a09b-7cec7eb62b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02040365-cb47-49b9-a09b-7cec7eb62b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093c8ea4-f9b1-414a-96bb-c2de8bc67fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093c8ea4-f9b1-414a-96bb-c2de8bc67fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a12aa4-5c19-4756-ac99-c4cf43465450', 'volume_name': 'volume-43a12aa4-5c19-4756-ac99-c4cf43465450', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239edd7a-6081-4fb1-9795-7b15f5d6a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239edd7a-6081-4fb1-9795-7b15f5d6a11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc54702-be12-401a-a245-d5011dcf2f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Volume 43a12aa4-5c19-4756-ac99-c4cf43465450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a12aa4-5c19-4756-ac99-c4cf43465450', 'volume_size': 1} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:20 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 1073741824" returned: 0 in 0.600s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:20 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 Nov 03 17:22:20 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:21 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" returned: 0 in 0.326s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-144648515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a12aa4-5c19-4756-ac99-c4cf43465450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26aa3bd52d94016a7be80007a676d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:21Z,use_quota=True,user_id='39f741868b8942a3bc9253819e78df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Creating volume 43a12aa4-5c19-4756-ac99-c4cf43465450 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:21 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dd176d-8269-4c7f-bdfe-cd144070a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:21 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 1073741824 Nov 03 17:22:21 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0a1646-854a-4a90-b29d-a668f0c48d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:21 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Volume volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 (4a7478dc-bdc8-4f32-9e3c-af6f48dac951): created successfully Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0a1646-854a-4a90-b29d-a668f0c48d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Flow 'volume_create_manager' (940baa8b-9fce-411d-8c5c-35fe52879488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8b45c3c5-7c7c-4660-9e90-2e7c2e1fa759 tempest-GroupSnapshotsV319Test-412681627 None] Created volume successfully. Nov 03 17:22:21 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 1073741824" returned: 0 in 0.618s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:21 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 Nov 03 17:22:21 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:22 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450" returned: 0 in 0.345s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc54702-be12-401a-a245-d5011dcf2f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a12aa4-5c19-4756-ac99-c4cf43465450', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41743fe8-9b77-47ae-8847-4a2b8f52acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:22 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Volume volume-43a12aa4-5c19-4756-ac99-c4cf43465450 (43a12aa4-5c19-4756-ac99-c4cf43465450): created successfully Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41743fe8-9b77-47ae-8847-4a2b8f52acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Flow 'volume_create_manager' (d320f19e-94ee-40da-bd0b-b9ade4c8eba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-55bd32f2-428c-4df1-9013-88e6ffb8ecb6 tempest-AttachVolumeShelveTestJSON-1989949486 None] Created volume successfully. Nov 03 17:22:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] GroupSnapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: creating. Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Group snapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: creating. {{(pid=86995) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Creating offline snapshot 5198d88a-ff85-479d-88ac-2ff6d92a7db4 of volume 4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1add4-839d-4275-a4e9-94fa1b3984c0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:23 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 Nov 03 17:22:23 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:24 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" returned: 0 in 0.639s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:24 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 1G Nov 03 17:22:24 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:24 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 1G" returned: 0 in 0.578s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:24 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 Nov 03 17:22:24 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:25 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4" returned: 0 in 0.455s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:25 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:25 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 Nov 03 17:22:25 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:25 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:25 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info Nov 03 17:22:25 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:25 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:25 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:22:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:25 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info Nov 03 17:22:25 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:26 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.info" returned: 0 in 0.424s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-80ce055b-432d-46e7-8f9a-9a362bfd5d6f tempest-GroupSnapshotsV319Test-412681627 None] group_snapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: created successfully Nov 03 17:22:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] group_snapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: deleting Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] group_snapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: deleting {{(pid=86995) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "cinder-quobyte-5198d88a-ff85-479d-88ac-2ff6d92a7db4" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-5198d88a-ff85-479d-88ac-2ff6d92a7db4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Deleting offline snapshot 5198d88a-ff85-479d-88ac-2ff6d92a7db4 of volume 4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] snapshot_file for this snap is: volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a781b2-9ab6-4bfa-91c2-61d1b6ea490c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:28 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 Nov 03 17:22:28 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:29 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4" returned: 0 in 0.911s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a48623f-57d8-4f24-ab84-cd3ff4d3f28e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:29 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 Nov 03 17:22:29 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:29 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" returned: 0 in 0.596s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:29 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 Nov 03 17:22:29 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:30 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4" returned: 0 in 0.723s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:30 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4 Nov 03 17:22:30 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:31 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951.5198d88a-ff85-479d-88ac-2ff6d92a7db4" returned: 0 in 0.611s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-5198d88a-ff85-479d-88ac-2ff6d92a7db4" released by "_delete_snapshot" :: held 3.032s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" released by "delete_snapshot" :: held 3.074s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:31 devstack cinder-volume[86995]: WARNING cinder.quota [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830468865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1830468865, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:22:31 devstack cinder-volume[86995]: WARNING cinder.quota [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830468865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1830468865, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:22:31 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] Created reservations ['56191faf-2d44-4e35-b946-9c17122ec043', 'b3ed5047-27ec-4c60-a9dd-b244c8105c94', '8845fe70-5618-422a-9785-5b4f353cebd1', '87b3b382-fde3-4546-989f-048ecedbec6c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9fdd3f84-6347-4f93-96c3-e2a2bf591a05 tempest-GroupSnapshotsV319Test-412681627 None] group_snapshot b78864b7-80d8-47b4-bdff-26a4a4bd9b6e: deleted successfully Nov 03 17:22:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afb9877-da73-45e3-904e-41f86e955eaf]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:32 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 Nov 03 17:22:32 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:33 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" returned: 0 in 0.701s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:33 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951 Nov 03 17:22:33 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:33 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" returned: 0 in 0.530s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Lock "cinder-quobyte-4a7478dc-bdc8-4f32-9e3c-af6f48dac951" released by "delete_volume" :: held 1.367s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Created reservations ['386c4535-2c96-4168-bd44-7727b24b4cd6'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:34 devstack cinder-volume[86995]: WARNING cinder.quota [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1830468865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1830468865, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Created reservations ['42f3319f-8233-4a6d-a3c0-819c8c337b8c', '195d7070-6d39-408f-94ba-f0ced07cde18', 'a1b1203d-7860-4364-9a0f-b2ff473b5aa4', 'dc8742b1-a764-4219-a8bf-f22a94bae44e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:34 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:22:34 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:34 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:34 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:22:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e4544964-c585-4594-aab5-37e7a0e85577 tempest-GroupSnapshotsV319Test-412681627 None] Delete group completed successfully. Nov 03 17:22:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-83081d6e-6a79-4bf1-92d7-9811271119f8 req-5a84f680-52c4-4891-911c-852a6514f72c tempest-ServerActionsTestOtherA-1577599008 None] Terminate volume connection completed successfully. Nov 03 17:22:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-83081d6e-6a79-4bf1-92d7-9811271119f8 req-5a84f680-52c4-4891-911c-852a6514f72c tempest-ServerActionsTestOtherA-1577599008 None] Deleting attachment 32b75282-4ff3-449e-a2b0-0754f76300b3. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:22:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:22:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 8 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:22:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:22:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-f6f091e8-5277-4235-aa34-856d99619cd3 req-f25e6ff4-943f-4c91-9eee-4e74a0dc0fb0 tempest-AttachVolumeShelveTestJSON-1989949486 None] No connector for attachment 0fccf035-4f40-4811-8b51-536cc7ee6abd; skipping storage backend terminate_connection call. {{(pid=86995) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 17:22:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-f6f091e8-5277-4235-aa34-856d99619cd3 req-f25e6ff4-943f-4c91-9eee-4e74a0dc0fb0 tempest-AttachVolumeShelveTestJSON-1989949486 None] Deleting attachment 0fccf035-4f40-4811-8b51-536cc7ee6abd. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Flow 'volume_create_manager' (aed32a28-5d65-4830-bd3f-8229f0008c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ec36fb-06aa-45f0-84d5-d7d56751addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ec36fb-06aa-45f0-84d5-d7d56751addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-371468680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233723eb-b54c-4cc5-a8f8-cd59f4bf4a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30b1d00a374635bbaa5bf3a7e31598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:45Z,use_quota=True,user_id='aa56bbfa88a449ab8e696bc29898a0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c9c29-5cc2-4e10-8fbb-8c9bb523686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c9c29-5cc2-4e10-8fbb-8c9bb523686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c25f60-7c9d-4a43-b43d-c6795d53d84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:45 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c25f60-7c9d-4a43-b43d-c6795d53d84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'volume_name': 'volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e0268-15f3-4900-9fae-0eeddeac38cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e0268-15f3-4900-9fae-0eeddeac38cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb697985-b442-427c-a50e-85a3f65e92b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Trying to clone 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 from image 0146c52b-9712-4e77-91c3-cd4953180efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:22:46 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557a1c6-bcaf-44c2-8573-7214bd2ddd86]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:46 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD Nov 03 17:22:46 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6ba64897-cb52-491f-a4ab-b48a9f94a576 tempest-GroupsV320Test-780132563 None] Group tempest-GroupsV320Test-Group-1039277881: creating Nov 03 17:22:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6ba64897-cb52-491f-a4ab-b48a9f94a576 tempest-GroupsV320Test-780132563 None] Group tempest-GroupsV320Test-Group-1039277881: created successfully Nov 03 17:22:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6ba64897-cb52-491f-a4ab-b48a9f94a576 tempest-GroupsV320Test-780132563 None] Create group completed successfully. Nov 03 17:22:47 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe is fetched for user aa56bbfa88a449ab8e696bc29898a0ed. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc59eb3-7abf-4abe-aea3-650f3342f733]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:47 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD Nov 03 17:22:47 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:47 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-371468680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233723eb-b54c-4cc5-a8f8-cd59f4bf4a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30b1d00a374635bbaa5bf3a7e31598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:45Z,use_quota=True,user_id='aa56bbfa88a449ab8e696bc29898a0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Creating volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:47 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:22:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:47 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1073741824 Nov 03 17:22:47 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:48 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1073741824" returned: 0 in 0.622s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:48 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 Nov 03 17:22:48 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:48 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" returned: 0 in 0.330s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Attempting download of 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Created reservations ['e888f3b2-115b-492f-995d-51e0f79351ff'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[09123e58-1bc1-4654-9d19-1e0f32ff07b8]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:48 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:22:48 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:48 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec Nov 03 17:22:48 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:49 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:22:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6ab4586b-d2fb-4169-87cc-b97bd0377429 tempest-GroupsV320Test-780132563 None] Delete group completed successfully. Nov 03 17:22:49 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:49 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec Nov 03 17:22:49 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:49 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec" returned: 1 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_0t734nec' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7f885-cdc0-492c-a68a-27fbcede9601]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:49 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD Nov 03 17:22:49 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:50 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:50 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] 0146c52b-9712-4e77-91c3-cd4953180efe was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:22:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:50 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 Nov 03 17:22:50 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:52 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" returned: 0 in 2.909s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:52 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_c8e6zvytdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:22:52 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Converted 112.00 MB image at 38.49 MB/s Nov 03 17:22:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:53 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1G Nov 03 17:22:53 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:53 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 1G" returned: 0 in 0.587s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Downloaded image 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe for user aa56bbfa88a449ab8e696bc29898a0ed is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Marking volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Copying metadata from image 0146c52b-9712-4e77-91c3-cd4953180efe to 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Creating volume glance metadata for volume 233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 backed by image 0146c52b-9712-4e77-91c3-cd4953180efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb697985-b442-427c-a50e-85a3f65e92b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb01506-885d-48bd-b7dc-0a3773f5b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:53 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Volume volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 (233723eb-b54c-4cc5-a8f8-cd59f4bf4a28): created successfully Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb01506-885d-48bd-b7dc-0a3773f5b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Flow 'volume_create_manager' (aed32a28-5d65-4830-bd3f-8229f0008c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9564b2ab-16f2-4677-a93a-108902449c70 tempest-ServerActionsTestOtherA-1577599008 None] Created volume successfully. Nov 03 17:22:54 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (e7e7d987-a5b6-4ba1-bc07-e0a7f2f42de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84ec7df-7f62-461d-abf2-cbc29bc74ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84ec7df-7f62-461d-abf2-cbc29bc74ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-875319568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33e606-178d-42e5-b57c-f0ca6c886ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:55Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16575029-e54a-4815-8941-6bcfa35cbd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16575029-e54a-4815-8941-6bcfa35cbd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e913a9b-1c5f-4500-a5cd-01d47324e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e913a9b-1c5f-4500-a5cd-01d47324e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf33e606-178d-42e5-b57c-f0ca6c886ccb', 'volume_name': 'volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e780617-2ca6-44ba-ad68-f9902325232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e780617-2ca6-44ba-ad68-f9902325232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2128792b-d3bf-4b81-af19-7056dfd15a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Volume bf33e606-178d-42e5-b57c-f0ca6c886ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb', 'volume_size': 1} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-875319568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33e606-178d-42e5-b57c-f0ca6c886ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:55Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Creating volume bf33e606-178d-42e5-b57c-f0ca6c886ccb {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:55 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:55 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb 1073741824 Nov 03 17:22:55 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:55 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb 1073741824" returned: 0 in 0.881s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:56 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb Nov 03 17:22:56 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:56 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2128792b-d3bf-4b81-af19-7056dfd15a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffcb8d1-c247-4f44-9e29-e1dd74fa1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Volume volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb (bf33e606-178d-42e5-b57c-f0ca6c886ccb): created successfully Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffcb8d1-c247-4f44-9e29-e1dd74fa1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (e7e7d987-a5b6-4ba1-bc07-e0a7f2f42de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e2bc002e-6ec8-49fc-a07f-ab4da701b1c8 tempest-AttachVolumeTestJSON-482886334 None] Created volume successfully. Nov 03 17:22:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db9e6701-7de4-4cd8-840b-282f2b6b0602 req-26f712e6-321f-4f28-ab19-d60e11c0fade tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db9e6701-7de4-4cd8-840b-282f2b6b0602 req-26f712e6-321f-4f28-ab19-d60e11c0fade tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-db9e6701-7de4-4cd8-840b-282f2b6b0602 req-26f712e6-321f-4f28-ab19-d60e11c0fade tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-db9e6701-7de4-4cd8-840b-282f2b6b0602 req-26f712e6-321f-4f28-ab19-d60e11c0fade tempest-AttachVolumeTestJSON-482886334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43aa974c-478d-4ba8-8ced-96480a9b9e73', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:22:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-db9e6701-7de4-4cd8-840b-282f2b6b0602 req-26f712e6-321f-4f28-ab19-d60e11c0fade tempest-AttachVolumeTestJSON-482886334 None] attachment_update completed successfully. Nov 03 17:22:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-9533c046-9f09-4651-9175-1ba89656fce8 req-a3328aaf-92ac-4db5-aa70-e0f9959157c3 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-9533c046-9f09-4651-9175-1ba89656fce8 req-a3328aaf-92ac-4db5-aa70-e0f9959157c3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-9533c046-9f09-4651-9175-1ba89656fce8 req-a3328aaf-92ac-4db5-aa70-e0f9959157c3 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-9533c046-9f09-4651-9175-1ba89656fce8 req-a3328aaf-92ac-4db5-aa70-e0f9959157c3 tempest-ServerActionsTestOtherA-1577599008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27e0edf5-3517-415b-a119-0326692b421f', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:22:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-9533c046-9f09-4651-9175-1ba89656fce8 req-a3328aaf-92ac-4db5-aa70-e0f9959157c3 tempest-ServerActionsTestOtherA-1577599008 None] attachment_update completed successfully. Nov 03 17:23:09 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=16,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:23:09 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=65,cinder:UPDATE=34,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:23:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-65c48c77-be7e-4725-9c15-a270a629e87e tempest-ServerActionsTestOtherA-1577599008 None] Terminate volume connection completed successfully. Nov 03 17:23:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-65c48c77-be7e-4725-9c15-a270a629e87e tempest-ServerActionsTestOtherA-1577599008 None] Deleting attachment 27e0edf5-3517-415b-a119-0326692b421f. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:23:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-96bd08c6-ffa8-4a9f-b046-7bc3a0e5f499 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-96bd08c6-ffa8-4a9f-b046-7bc3a0e5f499 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-96bd08c6-ffa8-4a9f-b046-7bc3a0e5f499 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-96bd08c6-ffa8-4a9f-b046-7bc3a0e5f499 tempest-ServerActionsTestOtherA-1577599008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa3612d5-8ea4-4a75-9fa8-8dac100bce5d', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:23:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-df50e48c-3248-4b94-bfd8-4655cd8fe356 req-96bd08c6-ffa8-4a9f-b046-7bc3a0e5f499 tempest-ServerActionsTestOtherA-1577599008 None] attachment_update completed successfully. Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Flow 'volume_create_manager' (6466f63b-9709-4a43-bdb3-77594f16bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d3d85c-e009-4e19-8f3e-e5f4d861b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d3d85c-e009-4e19-8f3e-e5f4d861b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1750743822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf663f75-aa8e-4df7-9aab-20cc664a96ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a190a789e14ff6a39a1357a0b8f854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:23:32Z,use_quota=True,user_id='70e8c23843f64346b414a90f7e52b05e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97802b82-43a5-4740-bb2e-c0056aab68d6),volume_type_id=97802b82-43a5-4740-bb2e-c0056aab68d6)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d13d6bb-8db7-4ebb-aef0-4456f785745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d13d6bb-8db7-4ebb-aef0-4456f785745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7c0110-1e76-4f5c-b11f-3e9a2c5d16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7c0110-1e76-4f5c-b11f-3e9a2c5d16e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf663f75-aa8e-4df7-9aab-20cc664a96ed', 'volume_name': 'volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b39803-154b-4eb2-bdf5-778001c34787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b39803-154b-4eb2-bdf5-778001c34787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffec6138-fe03-4da0-aed1-e759715fe872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Volume cf663f75-aa8e-4df7-9aab-20cc664a96ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed', 'volume_size': 1} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1750743822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf663f75-aa8e-4df7-9aab-20cc664a96ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a190a789e14ff6a39a1357a0b8f854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:23:32Z,use_quota=True,user_id='70e8c23843f64346b414a90f7e52b05e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97802b82-43a5-4740-bb2e-c0056aab68d6),volume_type_id=97802b82-43a5-4740-bb2e-c0056aab68d6)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Creating volume cf663f75-aa8e-4df7-9aab-20cc664a96ed {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:23:31 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:23:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:31 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed 1073741824 Nov 03 17:23:31 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:32 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed 1073741824" returned: 0 in 0.548s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:32 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed Nov 03 17:23:32 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:32 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed" returned: 0 in 0.290s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffec6138-fe03-4da0-aed1-e759715fe872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddd08ec-87f1-4ed6-870d-c0f1e0ff7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Volume volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed (cf663f75-aa8e-4df7-9aab-20cc664a96ed): created successfully Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddd08ec-87f1-4ed6-870d-c0f1e0ff7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Flow 'volume_create_manager' (6466f63b-9709-4a43-bdb3-77594f16bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:23:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5cbd65b7-98fd-4154-b643-c79770a33e2f tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Created volume successfully. Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:34 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:34 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:34 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.469s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:34 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-34063683-6f13-4932-a928-0bdce71fc5d9 tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Retype volume completed successfully. Nov 03 17:23:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-aee1e2cb-c99e-4947-b5f9-02822d484c33 req-55d90f24-a7ab-4ee3-b171-dffb767b6a67 tempest-AttachVolumeTestJSON-482886334 None] Terminate volume connection completed successfully. Nov 03 17:23:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-aee1e2cb-c99e-4947-b5f9-02822d484c33 req-55d90f24-a7ab-4ee3-b171-dffb767b6a67 tempest-AttachVolumeTestJSON-482886334 None] Deleting attachment 43aa974c-478d-4ba8-8ced-96480a9b9e73. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:23:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "cinder-cf663f75-aa8e-4df7-9aab-20cc664a96ed-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "cinder-cf663f75-aa8e-4df7-9aab-20cc664a96ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "cinder-quobyte-cf663f75-aa8e-4df7-9aab-20cc664a96ed" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "cinder-quobyte-cf663f75-aa8e-4df7-9aab-20cc664a96ed" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2ea449-34d5-4650-a187-e57a8e2aedf0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:36 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed Nov 03 17:23:36 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:36 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed" returned: 0 in 0.608s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:36 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed Nov 03 17:23:36 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:37 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cf663f75-aa8e-4df7-9aab-20cc664a96ed" returned: 0 in 0.579s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "cinder-quobyte-cf663f75-aa8e-4df7-9aab-20cc664a96ed" released by "delete_volume" :: held 1.258s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:37 devstack cinder-volume[86995]: WARNING cinder.quota [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:23:37 devstack cinder-volume[86995]: WARNING cinder.quota [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Created reservations ['8337ce07-da0b-45c1-9fdf-421be0e82875', '6088f505-c1eb-4b4d-9a13-6af96432203d', '3291632c-0060-4827-999a-718015e1a317', '8f3c3cf0-c588-4eb7-a9ab-9e773bd4bbbd'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:37 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:37 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:38 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.657s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Deleted volume successfully. Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d67f217b-596e-41af-99b4-78095100412b tempest-VolumeRetypeWithoutMigrationTest-1457833943 None] Lock "cinder-cf663f75-aa8e-4df7-9aab-20cc664a96ed-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:38 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:38 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:39 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.552s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:23:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:23:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:23:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Acquiring lock "cinder-43a12aa4-5c19-4756-ac99-c4cf43465450-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "cinder-43a12aa4-5c19-4756-ac99-c4cf43465450-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Acquiring lock "cinder-quobyte-43a12aa4-5c19-4756-ac99-c4cf43465450" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "cinder-quobyte-43a12aa4-5c19-4756-ac99-c4cf43465450" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a8d07-5559-4031-b2af-bc03a66bd062]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:44 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 Nov 03 17:23:44 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:44 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:44 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450 Nov 03 17:23:44 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:44 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-43a12aa4-5c19-4756-ac99-c4cf43465450" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "cinder-quobyte-43a12aa4-5c19-4756-ac99-c4cf43465450" released by "delete_volume" :: held 0.818s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Created reservations ['170df29b-da57-4543-847a-f82bc4a44f96', '60921e35-f300-4c93-bcfa-1aabe7129c84', 'acc9dfcb-9b90-44ba-bea2-eca2c7c17819', '5e627d39-6859-43c8-8664-ac05bd7c7a97'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:44 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:44 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:45 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.477s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Deleted volume successfully. Nov 03 17:23:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2ef0dcff-c9ad-42d8-9e0b-44d058cb7b96 tempest-AttachVolumeShelveTestJSON-1989949486 None] Lock "cinder-43a12aa4-5c19-4756-ac99-c4cf43465450-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Flow 'volume_create_manager' (4fec57fb-194e-4f42-be80-177f3151c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45744c3c-e9d4-422e-b9fe-2cdc0ff0c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45744c3c-e9d4-422e-b9fe-2cdc0ff0c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1355151622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71402d3f-4ca2-4171-9695-9a215c6390eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135ac301d55e470294d4d4f7267b056b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:23:49Z,use_quota=True,user_id='ee7ba036640d48df889f3c005fd5e3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398ab56-b29f-46be-af19-651f11f0b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398ab56-b29f-46be-af19-651f11f0b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0027b93-a1a7-4e82-bc37-ff53518a91e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0027b93-a1a7-4e82-bc37-ff53518a91e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71402d3f-4ca2-4171-9695-9a215c6390eb', 'volume_name': 'volume-71402d3f-4ca2-4171-9695-9a215c6390eb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cac05c-8337-491f-b310-2580a4928803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cac05c-8337-491f-b310-2580a4928803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72169c06-04bd-4e9f-b5c7-959440cb3f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Volume 71402d3f-4ca2-4171-9695-9a215c6390eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71402d3f-4ca2-4171-9695-9a215c6390eb', 'volume_size': 1} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1355151622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71402d3f-4ca2-4171-9695-9a215c6390eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135ac301d55e470294d4d4f7267b056b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:23:49Z,use_quota=True,user_id='ee7ba036640d48df889f3c005fd5e3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Creating volume 71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:23:48 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:23:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:48 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb 1073741824 Nov 03 17:23:48 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:49 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb 1073741824" returned: 0 in 0.547s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:49 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb Nov 03 17:23:49 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:50 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb" returned: 0 in 0.633s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72169c06-04bd-4e9f-b5c7-959440cb3f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71402d3f-4ca2-4171-9695-9a215c6390eb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df876f-8289-4998-aed6-acb633cf47bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:23:50 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Volume volume-71402d3f-4ca2-4171-9695-9a215c6390eb (71402d3f-4ca2-4171-9695-9a215c6390eb): created successfully Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df876f-8289-4998-aed6-acb633cf47bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:23:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Flow 'volume_create_manager' (4fec57fb-194e-4f42-be80-177f3151c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:23:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-af74dfac-9dee-404e-92a8-36a71c3a4135 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Created volume successfully. Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Creating offline snapshot 305d8e29-e238-4719-9842-e0d004a5fcb9 of volume 71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a95c80a-2193-4b7c-abd4-5846287296f1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:51 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb Nov 03 17:23:51 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:51 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb" returned: 0 in 0.516s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:51 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 1G Nov 03 17:23:51 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:52 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 1G" returned: 0 in 0.526s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71402d3f-4ca2-4171-9695-9a215c6390eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:52 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71402d3f-4ca2-4171-9695-9a215c6390eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 Nov 03 17:23:52 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:52 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71402d3f-4ca2-4171-9695-9a215c6390eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9" returned: 0 in 0.322s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:52 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 is being set with open permissions: ugo+rw Nov 03 17:23:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:52 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 Nov 03 17:23:52 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:53 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9" returned: 0 in 0.361s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:53 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info Nov 03 17:23:53 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:53 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info" returned: 0 in 0.344s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:53 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info is being set with open permissions: ugo+rw Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:53 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info Nov 03 17:23:53 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:53 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.info" returned: 0 in 0.461s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2a391cc6-fde7-4ce7-bd87-90ce0ff9d04f tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Create snapshot completed successfully Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "cinder-305d8e29-e238-4719-9842-e0d004a5fcb9-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-305d8e29-e238-4719-9842-e0d004a5fcb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "cinder-quobyte-305d8e29-e238-4719-9842-e0d004a5fcb9" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-305d8e29-e238-4719-9842-e0d004a5fcb9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Deleting offline snapshot 305d8e29-e238-4719-9842-e0d004a5fcb9 of volume 71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] snapshot_file for this snap is: volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254c337-1030-48ca-8887-dd24b385d54e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:55 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 Nov 03 17:23:55 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:56 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9" returned: 0 in 0.585s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71402d3f-4ca2-4171-9695-9a215c6390eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d7bfd-4712-46e2-b8af-1cffc8a94ff8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-01f18b36-523f-4a80-a38f-c35a3787be70 tempest-ServerActionsTestOtherA-1577599008 None] Terminate volume connection completed successfully. Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-01f18b36-523f-4a80-a38f-c35a3787be70 tempest-ServerActionsTestOtherA-1577599008 None] Deleting attachment fa3612d5-8ea4-4a75-9fa8-8dac100bce5d. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:23:56 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb Nov 03 17:23:56 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "cinder-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "cinder-quobyte-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-quobyte-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32c2c42-f114-4c6c-98f8-12d5ae7a1d60]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:56 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb" returned: 0 in 0.721s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:56 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 Nov 03 17:23:56 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:56 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 Nov 03 17:23:56 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:57 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" returned: 0 in 0.565s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:57 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9" returned: 0 in 0.494s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:57 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28 Nov 03 17:23:57 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:57 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9 Nov 03 17:23:57 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-05c012fe-4e32-4b49-a57d-d432e7a0d53a tempest-BackendsCapabilitiesAdminTestsJSON-1728984641 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5546951293945, 'free_capacity_gb': 1773.5546951293945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86995) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-11531c2b-93ef-424d-a9c0-32b246d2442d tempest-BackendsCapabilitiesAdminTestsJSON-1728984641 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5546951293945, 'free_capacity_gb': 1773.5546951293945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86995) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:23:57 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" returned: 0 in 0.293s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-quobyte-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28" released by "delete_volume" :: held 0.935s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:57 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb.305d8e29-e238-4719-9842-e0d004a5fcb9" returned: 0 in 0.334s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-305d8e29-e238-4719-9842-e0d004a5fcb9" released by "_delete_snapshot" :: held 2.307s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" released by "delete_snapshot" :: held 2.342s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.quota [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Created reservations ['425429d0-69e7-4327-b633-e81c66274905', '4b5f5898-bed4-499d-ac70-8e6bd90b4844', '553b8091-7716-40f4-a639-abab6253a131', '3c26b987-050d-4b02-a8c2-1897ef6b3258'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:23:57 devstack cinder-volume[86995]: WARNING cinder.quota [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Created reservations ['e128310b-fbb0-41f8-9520-b5ee455671ec', '8c2e71d7-4907-4e6f-a1f5-557671ff9d2b', 'c8003ec2-09d0-4d4e-a859-0fc0b03843ab', 'd7034a29-dc40-4221-8a9f-02f82871816d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:23:57 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:57 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Delete snapshot completed successfully. Nov 03 17:23:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f965350f-d392-4445-a91c-0a74d4e04280 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-305d8e29-e238-4719-9842-e0d004a5fcb9-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:58 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.313s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.manager [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Deleted volume successfully. Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-a6bf5036-cb28-46d9-8a01-0f031a558148 req-a4a67c99-6bb5-4cab-ba43-44e09e203373 tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-233723eb-b54c-4cc5-a8f8-cd59f4bf4a28-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "cinder-a1e3e905-929c-4c00-9f74-da81f2e0e395-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-a1e3e905-929c-4c00-9f74-da81f2e0e395-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "cinder-quobyte-a1e3e905-929c-4c00-9f74-da81f2e0e395" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-quobyte-a1e3e905-929c-4c00-9f74-da81f2e0e395" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef92ab34-e52b-49da-b258-12375a7064e4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:58 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 Nov 03 17:23:58 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "cinder-71402d3f-4ca2-4171-9695-9a215c6390eb-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-71402d3f-4ca2-4171-9695-9a215c6390eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:58 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395" returned: 0 in 0.413s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:23:58 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395 Nov 03 17:23:58 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e969c9-bf03-47b1-97c0-129649456bcf]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:23:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:59 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb Nov 03 17:23:59 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:59 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a1e3e905-929c-4c00-9f74-da81f2e0e395" returned: 0 in 0.347s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-quobyte-a1e3e905-929c-4c00-9f74-da81f2e0e395" released by "delete_volume" :: held 0.811s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Created reservations ['a2269cd8-0aff-436d-b82b-e6abadf050fb', '0fa2d02c-773c-4a1c-b68b-cc95eccffe42', '49ab3e4e-3e24-4a66-b061-77765329703b', 'e32ad260-fc61-48a7-9e65-f037faca2a1f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:59 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:23:59 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:59 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb" returned: 0 in 0.639s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:23:59 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb Nov 03 17:23:59 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:23:59 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.358s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:23:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Deleted volume successfully. Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-654b06cb-ca43-4d30-a59d-f882e45ad60b tempest-ServerActionsTestOtherA-1577599008 None] Lock "cinder-a1e3e905-929c-4c00-9f74-da81f2e0e395-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:59 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71402d3f-4ca2-4171-9695-9a215c6390eb" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-quobyte-71402d3f-4ca2-4171-9695-9a215c6390eb" released by "delete_volume" :: held 1.093s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:23:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Created reservations ['f73e50f6-b84f-40aa-91b1-2538db045be1', '8211bc23-42d3-43db-bfa1-1029cd230959', '8bfc2f6f-d7b7-4a82-ac45-8e7b4efed792', '3f73cd33-6ce4-4efb-8bbf-b20f110d791c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:00 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:00 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:00 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.367s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Deleted volume successfully. Nov 03 17:24:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298dec92-929d-4c8c-b572-46796da13e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1126165628 None] Lock "cinder-71402d3f-4ca2-4171-9695-9a215c6390eb-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e2af1ba6-7cce-423a-a6b6-661a03dbbfb2 tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-159970674: creating Nov 03 17:24:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e2af1ba6-7cce-423a-a6b6-661a03dbbfb2 tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-159970674: created successfully Nov 03 17:24:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e2af1ba6-7cce-423a-a6b6-661a03dbbfb2 tempest-GroupSnapshotsTest-321830584 None] Create group completed successfully. Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (f74a50f7-279c-448c-90ff-35489d69f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b869bd90-219d-42ec-803d-ee1f5f9704b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b869bd90-219d-42ec-803d-ee1f5f9704b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913544974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c9282fd-2e0d-4853-9556-8f7ead6f39e0,host='devstack@QuobyteHD#QuobyteHD',id=011b2be0-6577-43f7-a2d8-c4a4563d1097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:08Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df2ac459-189c-4607-91a5-959cb6fdb31d),volume_type_id=df2ac459-189c-4607-91a5-959cb6fdb31d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a79ffc-c9c4-4508-bd4b-d40b44c8d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a79ffc-c9c4-4508-bd4b-d40b44c8d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfd19ce-f273-493c-ac26-a23de5a1e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfd19ce-f273-493c-ac26-a23de5a1e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011b2be0-6577-43f7-a2d8-c4a4563d1097', 'volume_name': 'volume-011b2be0-6577-43f7-a2d8-c4a4563d1097', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b5f47a-1eff-452a-a3dd-9ff7918fed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b5f47a-1eff-452a-a3dd-9ff7918fed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dff50b-c29a-4df0-a953-e94a65f2ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Volume 011b2be0-6577-43f7-a2d8-c4a4563d1097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011b2be0-6577-43f7-a2d8-c4a4563d1097', 'volume_size': 1} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c9282fd-2e0d-4853-9556-8f7ead6f39e0,created_at=2026-11-03T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913544974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c9282fd-2e0d-4853-9556-8f7ead6f39e0,host='devstack@QuobyteHD#QuobyteHD',id=011b2be0-6577-43f7-a2d8-c4a4563d1097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:08Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df2ac459-189c-4607-91a5-959cb6fdb31d),volume_type_id=df2ac459-189c-4607-91a5-959cb6fdb31d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Creating volume 011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:08 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:08 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 1073741824 Nov 03 17:24:08 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:09 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 1073741824" returned: 0 in 0.774s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:09 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:09 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:09 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dff50b-c29a-4df0-a953-e94a65f2ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011b2be0-6577-43f7-a2d8-c4a4563d1097', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2e0a04-b4c1-46db-818c-607599ec3b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:09 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Volume volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 (011b2be0-6577-43f7-a2d8-c4a4563d1097): created successfully Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2e0a04-b4c1-46db-818c-607599ec3b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (f74a50f7-279c-448c-90ff-35489d69f62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2a222530-c709-44c1-9c74-4282e62e2b5e tempest-GroupSnapshotsTest-321830584 None] Created volume successfully. Nov 03 17:24:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] GroupSnapshot d9468b14-3562-4288-856e-4b6b48f933ad: creating. Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Group snapshot d9468b14-3562-4288-856e-4b6b48f933ad: creating. {{(pid=86995) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Creating offline snapshot 430852c7-5e90-4a91-8c85-d2e6ab07e04b of volume 011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e548ba-2f4c-4905-b7ff-0bc39ca8bc0a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:11 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:11 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:11 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.473s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:11 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b 1G Nov 03 17:24:11 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:11 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b 1G" returned: 0 in 0.542s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:12 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:12 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:12 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.431s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:12 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:12 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:12 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:12 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:12 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info Nov 03 17:24:12 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:13 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info" returned: 0 in 0.392s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:13 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:13 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info Nov 03 17:24:13 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:13 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.info" returned: 0 in 0.408s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:13 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-eb3a6462-4976-42a2-9539-debe7d6d65c6 tempest-GroupSnapshotsTest-321830584 None] group_snapshot d9468b14-3562-4288-856e-4b6b48f933ad: created successfully Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Flow 'volume_create_manager' (b37aa771-627b-4ae2-8d2d-dc585e982dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a986b5-2e90-42d1-ac9d-531542757d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a986b5-2e90-42d1-ac9d-531542757d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1775711595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348fcc71-3d10-4713-8e94-7a68210ba1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472d230fb2d4518bcac78b6c1b64712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:15Z,use_quota=True,user_id='c25527b48f104a4d8639695164127501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ebcfa2-3f64-44a2-b018-b663a9ade7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ebcfa2-3f64-44a2-b018-b663a9ade7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa5c1b-ee29-4288-a258-f33980aabef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa5c1b-ee29-4288-a258-f33980aabef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348fcc71-3d10-4713-8e94-7a68210ba1d7', 'volume_name': 'volume-348fcc71-3d10-4713-8e94-7a68210ba1d7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a562ff-f02b-4e57-9eb3-73ba49dca023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a562ff-f02b-4e57-9eb3-73ba49dca023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b623a2a-95be-4606-af18-35b761165079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Volume 348fcc71-3d10-4713-8e94-7a68210ba1d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348fcc71-3d10-4713-8e94-7a68210ba1d7', 'volume_size': 1} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1775711595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348fcc71-3d10-4713-8e94-7a68210ba1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472d230fb2d4518bcac78b6c1b64712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:15Z,use_quota=True,user_id='c25527b48f104a4d8639695164127501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Creating volume 348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:15 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:15 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 1073741824 Nov 03 17:24:15 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:16 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 1073741824" returned: 0 in 0.587s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:16 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 Nov 03 17:24:16 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:16 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.435s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b-decb5d46-cc05-4a2e-97a3-90ede820d76d" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b623a2a-95be-4606-af18-35b761165079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348fcc71-3d10-4713-8e94-7a68210ba1d7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6588b629-edbc-4802-9cd9-82c9edfef7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b-decb5d46-cc05-4a2e-97a3-90ede820d76d" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Creating volume decb5d46-cc05-4a2e-97a3-90ede820d76d from snapshot 430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Volume volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 (348fcc71-3d10-4713-8e94-7a68210ba1d7): created successfully Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6588b629-edbc-4802-9cd9-82c9edfef7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Flow 'volume_create_manager' (b37aa771-627b-4ae2-8d2d-dc585e982dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] snapshot: 430852c7-5e90-4a91-8c85-d2e6ab07e04b, volume: decb5d46-cc05-4a2e-97a3-90ede820d76d, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:24:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-510d587a-ad0e-4640-96a3-5a0fb9b83dc3 req-1725bb60-11be-4689-bfcb-ea86774863b5 tempest-VolumesSnapshotsTestJSON-933443146 None] Created volume successfully. Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dbdcab-b816-47ec-ac39-b0ab3ff1b387]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:16 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:16 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:17 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.470s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011b2be0-6577-43f7-a2d8-c4a4563d1097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5999d700-321e-40c5-a506-dc2c5c229c25]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:17 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:17 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:17 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.537s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:24:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:17 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d Nov 03 17:24:17 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:26 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=75,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:24:26 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d" returned: 0 in 8.981s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:26 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:24:26 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Converted 1024.00 MB image at 114.00 MB/s Nov 03 17:24:26 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:26 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d Nov 03 17:24:26 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:27 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d" returned: 0 in 0.666s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" released by "_copy_volume_from_snapshot" :: held 10.797s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=65,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b-decb5d46-cc05-4a2e-97a3-90ede820d76d" released by "_create_volume_from_snapshot" :: held 10.937s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.990s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.158s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Creating offline snapshot ffbba109-60e1-416e-8e65-6c371060bf2f of volume 348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f76d6f-a760-4ef8-955c-7c76be5a6c2e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c6bfbe5c-f386-43fa-b887-d5a6036ff1d7 tempest-GroupSnapshotsTest-321830584 None] Create group from source-snapshot-d9468b14-3562-4288-856e-4b6b48f933ad completed successfully. Nov 03 17:24:27 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 Nov 03 17:24:27 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:28 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7" returned: 0 in 0.644s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:28 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f 1G Nov 03 17:24:28 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:28 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f 1G" returned: 0 in 0.558s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:28 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f Nov 03 17:24:28 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f13914-7b01-48b7-8d76-86a2edb90df1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:29 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f" returned: 0 in 0.698s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:29 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f is being set with open permissions: ugo+rw Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:29 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f Nov 03 17:24:29 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:29 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d Nov 03 17:24:29 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:29 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f" returned: 0 in 0.450s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:30 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d" returned: 0 in 0.625s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:30 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d Nov 03 17:24:30 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:30 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info Nov 03 17:24:30 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:30 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info" returned: 0 in 0.452s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:30 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info is being set with open permissions: ugo+rw Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:30 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info Nov 03 17:24:30 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:30 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-decb5d46-cc05-4a2e-97a3-90ede820d76d" returned: 0 in 0.622s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-decb5d46-cc05-4a2e-97a3-90ede820d76d" released by "delete_volume" :: held 1.352s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Created reservations ['5f80934c-47ee-494a-91ff-9f47ca7998e0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:30 devstack cinder-volume[86995]: WARNING cinder.quota [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1494142004 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1494142004, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:24:30 devstack cinder-volume[86995]: WARNING cinder.quota [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1494142004 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1494142004, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:24:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Created reservations ['31c30f60-2eb3-49ba-a6da-cc2be7d80121', '50348961-56c0-443b-9cd2-1edb10c529d7', '4bc5037b-fdc8-482b-9fe6-cc5779ce54da', '49dbf430-6edd-4eaf-8fee-ddf147014651'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:31 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.info" returned: 0 in 0.521s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-8602eb42-c80f-45b3-96c0-c22599ff4773 req-d946fb3b-2226-4823-a84c-cccd362d99fb tempest-VolumesSnapshotsTestJSON-933443146 None] Create snapshot completed successfully Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:31 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:31 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:31 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.319s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:31 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-49cc3f2f-a548-4ada-9f5d-936cf5d2206d tempest-GroupSnapshotsTest-321830584 None] Delete group completed successfully. Nov 03 17:24:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] group_snapshot d9468b14-3562-4288-856e-4b6b48f933ad: deleting Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "cinder-ffbba109-60e1-416e-8e65-6c371060bf2f-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-ffbba109-60e1-416e-8e65-6c371060bf2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] group_snapshot d9468b14-3562-4288-856e-4b6b48f933ad: deleting {{(pid=86995) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "cinder-quobyte-ffbba109-60e1-416e-8e65-6c371060bf2f" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-ffbba109-60e1-416e-8e65-6c371060bf2f" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Deleting offline snapshot ffbba109-60e1-416e-8e65-6c371060bf2f of volume 348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] snapshot_file for this snap is: volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" acquired by "delete_snapshot" :: waited 0.112s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f2fdb0-3f68-4848-8ff2-8999164af5fb]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Deleting offline snapshot 430852c7-5e90-4a91-8c85-d2e6ab07e04b of volume 011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] snapshot_file for this snap is: volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b970836-df47-418c-a481-90bf8dc56e0b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:32 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f Nov 03 17:24:32 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:32 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:32 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:33 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f" returned: 0 in 0.524s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-348fcc71-3d10-4713-8e94-7a68210ba1d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:24:33 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.475s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011b2be0-6577-43f7-a2d8-c4a4563d1097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[81427562-20ca-4eed-80cb-0b9295a0cc11]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33b4a7-623f-434a-8207-de3930b76b21]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:33 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 Nov 03 17:24:33 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:33 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:33 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:33 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7" returned: 0 in 0.500s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:33 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f Nov 03 17:24:33 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:33 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.863s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:34 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:34 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:34 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f" returned: 0 in 0.582s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:34 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f Nov 03 17:24:34 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:34 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.444s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:34 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b Nov 03 17:24:34 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:34 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7.ffbba109-60e1-416e-8e65-6c371060bf2f" returned: 0 in 0.323s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-ffbba109-60e1-416e-8e65-6c371060bf2f" released by "_delete_snapshot" :: held 2.150s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" released by "delete_snapshot" :: held 2.209s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.quota [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Created reservations ['35185ca9-8dbc-4ced-abf9-396a7c19f12a', 'd9344ad0-383e-4b21-9307-25326ecd6ff7', 'f968905a-f2d4-4eb4-a009-48da18d2754f', 'cf75add8-43dd-46d2-9670-6a525c0dce26'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Delete snapshot completed successfully. Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-5aa18f04-c3d8-4119-a8fe-cff3f6818ce8 req-86e152b5-51b0-48a8-b9aa-e4580492e437 tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-ffbba109-60e1-416e-8e65-6c371060bf2f-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:34 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097.430852c7-5e90-4a91-8c85-d2e6ab07e04b" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-430852c7-5e90-4a91-8c85-d2e6ab07e04b" released by "_delete_snapshot" :: held 2.241s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" released by "delete_snapshot" :: held 2.298s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:34 devstack cinder-volume[86995]: WARNING cinder.quota [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1494142004 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1494142004, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:24:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['35bc0554-2645-4950-bc0d-781aaaeb1905', 'b155d92b-d5f0-4233-add8-80557d8ec77f', 'e81edb35-c432-44cc-8b2f-972ca974e20b', 'c8b84443-7069-418c-aae9-7db3db243afd'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5af42d31-013a-43a5-9015-d27638102790 tempest-GroupSnapshotsTest-321830584 None] group_snapshot d9468b14-3562-4288-856e-4b6b48f933ad: deleted successfully Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "cinder-348fcc71-3d10-4713-8e94-7a68210ba1d7-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-348fcc71-3d10-4713-8e94-7a68210ba1d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb0555-cd6a-41a2-b8ae-f48bddd19613]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:36 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 Nov 03 17:24:36 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" acquired by "delete_volume" :: waited 0.050s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd7ffb6-5ada-4264-874a-e95eb800af52]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:36 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:36 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:36 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7" returned: 0 in 0.727s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:36 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7 Nov 03 17:24:36 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:37 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.710s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:37 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097 Nov 03 17:24:37 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:37 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-348fcc71-3d10-4713-8e94-7a68210ba1d7" returned: 0 in 0.541s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-quobyte-348fcc71-3d10-4713-8e94-7a68210ba1d7" released by "delete_volume" :: held 1.398s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG cinder.quota [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Created reservations ['dc4a2c7b-4b6c-4703-8f40-66eb882bda0c', '1b0773de-53b2-4fac-a9ea-afcf02b42713', '09d4436b-0b8c-47db-9e84-6e5efc9ce539', '391c053c-eec3-4600-8c81-5d45add811c4'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:37 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:37 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:37 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG cinder.manager [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Deleted volume successfully. Nov 03 17:24:37 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-011b2be0-6577-43f7-a2d8-c4a4563d1097" returned: 0 in 0.843s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-011b2be0-6577-43f7-a2d8-c4a4563d1097" released by "delete_volume" :: held 1.699s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-716f9341-ad72-4b30-8647-693f4801a850 req-27a14b69-ea8b-4739-b077-71e5295c679c tempest-VolumesSnapshotsTestJSON-933443146 None] Lock "cinder-348fcc71-3d10-4713-8e94-7a68210ba1d7-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['3cac3887-e726-445c-b8ca-ba657822a7bb'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:38 devstack cinder-volume[86995]: WARNING cinder.db.api [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1494142004'] Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['62900b02-9d68-4452-90ea-4aff2dde269b', '337ab25c-7a05-4337-abd3-532a34e3607b', '4809dce9-8670-4186-b68b-4c768abf8e56', '011908fc-8ab5-4670-bbb6-878fe982ce71'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:38 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:38 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:38 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:38 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:39 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.742s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7d07dd9a-efa7-451a-a54f-92f8986a1548 tempest-GroupSnapshotsTest-321830584 None] Delete group completed successfully. Nov 03 17:24:39 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.621s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:24:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:24:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-494f5ce1-f2ce-4b75-b9b0-96bc5a8b9033 tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-1019849524: creating Nov 03 17:24:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-494f5ce1-f2ce-4b75-b9b0-96bc5a8b9033 tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-1019849524: created successfully Nov 03 17:24:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-494f5ce1-f2ce-4b75-b9b0-96bc5a8b9033 tempest-GroupSnapshotsTest-321830584 None] Create group completed successfully. Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (fedb2448-82ec-4c58-b57c-3dc6a49380c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97036160-9d15-40d4-bdb9-b2a40eaf2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97036160-9d15-40d4-bdb9-b2a40eaf2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724955512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29aada89-1a04-4c91-8112-0cabf154549b,host='devstack@QuobyteHD#QuobyteHD',id=ced23924-8288-479d-96f7-67521c57bdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:42Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643bfab8-098b-4c2e-b32a-542f2baddb86),volume_type_id=643bfab8-098b-4c2e-b32a-542f2baddb86)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745bcb95-3a5d-4c49-9088-44243825ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745bcb95-3a5d-4c49-9088-44243825ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e8024e-c68b-44fb-a7c6-ba3b8c5dd967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e8024e-c68b-44fb-a7c6-ba3b8c5dd967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced23924-8288-479d-96f7-67521c57bdd5', 'volume_name': 'volume-ced23924-8288-479d-96f7-67521c57bdd5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d551c87-708f-4321-8c81-ec3a6ac74523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d551c87-708f-4321-8c81-ec3a6ac74523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170fd675-e16f-4c97-b723-683ca3042d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Volume ced23924-8288-479d-96f7-67521c57bdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced23924-8288-479d-96f7-67521c57bdd5', 'volume_size': 1} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29aada89-1a04-4c91-8112-0cabf154549b,created_at=2026-11-03T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724955512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29aada89-1a04-4c91-8112-0cabf154549b,host='devstack@QuobyteHD#QuobyteHD',id=ced23924-8288-479d-96f7-67521c57bdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:42Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643bfab8-098b-4c2e-b32a-542f2baddb86),volume_type_id=643bfab8-098b-4c2e-b32a-542f2baddb86)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Creating volume ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:42 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:42 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 1073741824 Nov 03 17:24:42 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:43 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 1073741824" returned: 0 in 0.780s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:43 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 Nov 03 17:24:43 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:43 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5" returned: 0 in 0.344s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170fd675-e16f-4c97-b723-683ca3042d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced23924-8288-479d-96f7-67521c57bdd5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e9f4cf-0c5e-4da5-8b7f-ecea43e36324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:43 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Volume volume-ced23924-8288-479d-96f7-67521c57bdd5 (ced23924-8288-479d-96f7-67521c57bdd5): created successfully Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e9f4cf-0c5e-4da5-8b7f-ecea43e36324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (fedb2448-82ec-4c58-b57c-3dc6a49380c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f4f7628d-dc5c-4a64-a970-8d6e635b66c9 tempest-GroupSnapshotsTest-321830584 None] Created volume successfully. Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (d561c994-7f1d-44b5-bddc-7851f540963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ab9f82-b4eb-4cc5-a172-667a1d15e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ab9f82-b4eb-4cc5-a172-667a1d15e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1896920711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c71d474-757c-4704-bd67-03d8c36c6468,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:45Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3552407d-ef4d-44dd-ae13-11a3abf658f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3552407d-ef4d-44dd-ae13-11a3abf658f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a96f35-f1dd-40cb-b39c-ad4aac8b9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a96f35-f1dd-40cb-b39c-ad4aac8b9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c71d474-757c-4704-bd67-03d8c36c6468', 'volume_name': 'volume-6c71d474-757c-4704-bd67-03d8c36c6468', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874523e-5f55-4c20-ae7c-0f7c4a361b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874523e-5f55-4c20-ae7c-0f7c4a361b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db0e57f-948b-4689-aee8-bf51810fba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Volume 6c71d474-757c-4704-bd67-03d8c36c6468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c71d474-757c-4704-bd67-03d8c36c6468', 'volume_size': 1} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1896920711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c71d474-757c-4704-bd67-03d8c36c6468,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:45Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Creating volume 6c71d474-757c-4704-bd67-03d8c36c6468 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:44 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:44 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 1073741824 Nov 03 17:24:44 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:45 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 1073741824" returned: 0 in 0.494s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:45 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 Nov 03 17:24:45 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (9e8f3919-9299-43ba-a678-1abe77fdef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113848db-2ab0-46b1-92d3-e62666b378af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113848db-2ab0-46b1-92d3-e62666b378af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428053427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29aada89-1a04-4c91-8112-0cabf154549b,host='devstack@QuobyteHD#QuobyteHD',id=b929a6dc-e7fc-4fda-8cd1-2bb648522866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:45Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643bfab8-098b-4c2e-b32a-542f2baddb86),volume_type_id=643bfab8-098b-4c2e-b32a-542f2baddb86)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5201b-626c-464e-b08d-77c10793a85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5201b-626c-464e-b08d-77c10793a85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1047e8c-055b-4153-8833-21a8a76c358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1047e8c-055b-4153-8833-21a8a76c358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b929a6dc-e7fc-4fda-8cd1-2bb648522866', 'volume_name': 'volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b0c435-6a8c-43dc-9d80-329b24d4c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b0c435-6a8c-43dc-9d80-329b24d4c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa066b4f-e9ec-4b13-88b3-cecbd63d69f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Volume b929a6dc-e7fc-4fda-8cd1-2bb648522866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866', 'volume_size': 1} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468" returned: 0 in 0.401s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29aada89-1a04-4c91-8112-0cabf154549b,created_at=2026-11-03T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428053427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29aada89-1a04-4c91-8112-0cabf154549b,host='devstack@QuobyteHD#QuobyteHD',id=b929a6dc-e7fc-4fda-8cd1-2bb648522866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:45Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643bfab8-098b-4c2e-b32a-542f2baddb86),volume_type_id=643bfab8-098b-4c2e-b32a-542f2baddb86)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Creating volume b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:45 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db0e57f-948b-4689-aee8-bf51810fba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c71d474-757c-4704-bd67-03d8c36c6468', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 1073741824 Nov 03 17:24:45 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4893f408-0c3e-4507-94cf-c98f8eca1ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Volume volume-6c71d474-757c-4704-bd67-03d8c36c6468 (6c71d474-757c-4704-bd67-03d8c36c6468): created successfully Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4893f408-0c3e-4507-94cf-c98f8eca1ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (d561c994-7f1d-44b5-bddc-7851f540963f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8be13fe1-1968-48e1-a0c3-44d071761721 tempest-VolumesTestJSON-320988493 None] Created volume successfully. Nov 03 17:24:46 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 1073741824" returned: 0 in 0.499s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:46 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 Nov 03 17:24:46 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:46 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa066b4f-e9ec-4b13-88b3-cecbd63d69f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295ab2de-dee9-445f-8852-8ce748d47589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Volume volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 (b929a6dc-e7fc-4fda-8cd1-2bb648522866): created successfully Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295ab2de-dee9-445f-8852-8ce748d47589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (9e8f3919-9299-43ba-a678-1abe77fdef8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a69ad123-c93d-4aa4-ba31-28e06623d33d tempest-GroupSnapshotsTest-321830584 None] Created volume successfully. Nov 03 17:24:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-89e89331-8077-4569-948a-e5d82f76974e tempest-GroupSnapshotsTest-321830584 None] Update group completed successfully. Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (03748d66-5e05-4a11-ad6f-794a2610a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3f1e63-edd7-4ab2-82c1-b431f74b9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3f1e63-edd7-4ab2-82c1-b431f74b9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992106426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b0571d-2cd8-49a0-9c68-90401ff2d77b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:48Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fe5089-6f63-4886-872b-0925594f3af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fe5089-6f63-4886-872b-0925594f3af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baab4927-6174-4c31-ba01-1d42de199bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baab4927-6174-4c31-ba01-1d42de199bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b0571d-2cd8-49a0-9c68-90401ff2d77b', 'volume_name': 'volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9d9270-adab-4962-b8e3-4895f141b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9d9270-adab-4962-b8e3-4895f141b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d572c2c-8066-495a-ab43-45a35e964d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Volume 86b0571d-2cd8-49a0-9c68-90401ff2d77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b', 'volume_size': 1} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992106426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b0571d-2cd8-49a0-9c68-90401ff2d77b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:48Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Creating volume 86b0571d-2cd8-49a0-9c68-90401ff2d77b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:47 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:47 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b 1073741824 Nov 03 17:24:47 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2fdae107-b329-487f-b547-7399b83f64eb tempest-GroupSnapshotsTest-321830584 None] Update group completed successfully. Nov 03 17:24:48 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b 1073741824" returned: 0 in 0.584s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:48 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b Nov 03 17:24:48 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:48 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b" returned: 0 in 0.287s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d572c2c-8066-495a-ab43-45a35e964d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6412ab4-ec6c-4a3f-85b3-0787daecb611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Volume volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b (86b0571d-2cd8-49a0-9c68-90401ff2d77b): created successfully Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6412ab4-ec6c-4a3f-85b3-0787daecb611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (03748d66-5e05-4a11-ad6f-794a2610a871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9f1b0e24-5d02-4161-b73d-2af082f84f8a tempest-VolumesTestJSON-320988493 None] Created volume successfully. Nov 03 17:24:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3bdcac67-a575-47e1-9c02-92193e1b652b tempest-GroupSnapshotsTest-321830584 None] Update group completed successfully. Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (c3df20d0-364a-4410-9d43-d282fd8dddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad868fc-d823-4e88-b7ed-9ad31d425718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad868fc-d823-4e88-b7ed-9ad31d425718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-458863763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a5d30f-b67a-4f38-96d3-37db1698e402,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:51Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06602f1f-1b71-499f-a2ea-9d3945e358db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06602f1f-1b71-499f-a2ea-9d3945e358db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76380f9-de9f-4661-b237-8881e9929111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76380f9-de9f-4661-b237-8881e9929111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a5d30f-b67a-4f38-96d3-37db1698e402', 'volume_name': 'volume-f1a5d30f-b67a-4f38-96d3-37db1698e402', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a44b17-7411-426f-b9f0-2801eb7bc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a44b17-7411-426f-b9f0-2801eb7bc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8589c0ff-4d4e-4b51-b606-4064b2e02f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:51 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Volume f1a5d30f-b67a-4f38-96d3-37db1698e402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a5d30f-b67a-4f38-96d3-37db1698e402', 'volume_size': 1} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-458863763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a5d30f-b67a-4f38-96d3-37db1698e402,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c833f4bfe16e47108c91bc0820562119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:51Z,use_quota=True,user_id='5bada2b3f4fa4cab9ff1e619f548e82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Creating volume f1a5d30f-b67a-4f38-96d3-37db1698e402 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:51 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:51 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 1073741824 Nov 03 17:24:51 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6ecb850d-984d-4c1c-82ff-36e6e400c14e tempest-GroupSnapshotsTest-321830584 None] Update group completed successfully. Nov 03 17:24:51 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 1073741824" returned: 0 in 0.838s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:51 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 Nov 03 17:24:51 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (6ace917d-747c-4be9-931a-2af0480df3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a6f88c-c7df-45ad-bff0-1e88cbe79c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a6f88c-c7df-45ad-bff0-1e88cbe79c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1934987528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e555443c-17e4-474d-8f52-c441f58420b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:52Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4147d262-07be-4697-9578-309e7a1556e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4147d262-07be-4697-9578-309e7a1556e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4dd850-db79-4d4a-b33c-0b2f9822a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4dd850-db79-4d4a-b33c-0b2f9822a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e555443c-17e4-474d-8f52-c441f58420b4', 'volume_name': 'volume-e555443c-17e4-474d-8f52-c441f58420b4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f8187c-c867-4af2-8e89-0e858961adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f8187c-c867-4af2-8e89-0e858961adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844de18e-1ff7-47e4-929b-05a6e949c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Volume e555443c-17e4-474d-8f52-c441f58420b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e555443c-17e4-474d-8f52-c441f58420b4', 'volume_size': 1} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:52 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402" returned: 0 in 0.533s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1934987528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e555443c-17e4-474d-8f52-c441f58420b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:52Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Creating volume e555443c-17e4-474d-8f52-c441f58420b4 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:52 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8589c0ff-4d4e-4b51-b606-4064b2e02f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a5d30f-b67a-4f38-96d3-37db1698e402', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dc93a9-9a26-4f5d-92c0-31e782adf282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:52 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 1073741824 Nov 03 17:24:52 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:52 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Volume volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 (f1a5d30f-b67a-4f38-96d3-37db1698e402): created successfully Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dc93a9-9a26-4f5d-92c0-31e782adf282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Flow 'volume_create_manager' (c3df20d0-364a-4410-9d43-d282fd8dddef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f8d798fe-62ba-4f7f-8340-f1292acfd78b tempest-VolumesTestJSON-320988493 None] Created volume successfully. Nov 03 17:24:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] GroupSnapshot 30434534-22c8-4e4e-bb26-cef62796afde: creating. Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Group snapshot 30434534-22c8-4e4e-bb26-cef62796afde: creating. {{(pid=86995) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:53 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 1073741824" returned: 0 in 0.797s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:53 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 Nov 03 17:24:53 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:53 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844de18e-1ff7-47e4-929b-05a6e949c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e555443c-17e4-474d-8f52-c441f58420b4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02dfb42-387f-4c61-8ada-ad88bb20191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Creating offline snapshot 50334519-9379-40c0-8b2c-0bebda98b95d of volume b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:24:53 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Volume volume-e555443c-17e4-474d-8f52-c441f58420b4 (e555443c-17e4-474d-8f52-c441f58420b4): created successfully Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02dfb42-387f-4c61-8ada-ad88bb20191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (6ace917d-747c-4be9-931a-2af0480df3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559666b-528a-4ea1-8fa2-9d29375b0098]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3fa340bd-c7b3-4be5-b974-2d0896af14e7 tempest-AttachVolumeTestJSON-482886334 None] Created volume successfully. Nov 03 17:24:53 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (fb5ca1bf-683c-4e8e-b2f0-92dcb4f51861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2cd994-fb09-4446-8a9c-343f81f539e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:54 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 Nov 03 17:24:54 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2cd994-fb09-4446-8a9c-343f81f539e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246048762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:54Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f730711-7e14-445b-8cfe-06903d21e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f730711-7e14-445b-8cfe-06903d21e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62604f86-d46d-4995-8326-915b6b388ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62604f86-d46d-4995-8326-915b6b388ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd', 'volume_name': 'volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff218a3-e052-47d6-a959-3a0281cd319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff218a3-e052-47d6-a959-3a0281cd319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf92420c-aa31-4c7d-b29f-0bc80c33b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:24:54 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Volume 2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd', 'volume_size': 1} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-f1a5d30f-b67a-4f38-96d3-37db1698e402-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "cinder-f1a5d30f-b67a-4f38-96d3-37db1698e402-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:54 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866" returned: 0 in 0.552s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-quobyte-f1a5d30f-b67a-4f38-96d3-37db1698e402" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-f1a5d30f-b67a-4f38-96d3-37db1698e402" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:54 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d 1G Nov 03 17:24:54 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de6954-7049-4bab-b677-df4bac219aa3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:54 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 Nov 03 17:24:54 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:55 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d 1G" returned: 0 in 0.587s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:55 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:55 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d Nov 03 17:24:55 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402" returned: 0 in 0.571s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:55 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402 Nov 03 17:24:55 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:55 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d" returned: 0 in 0.447s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:55 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:55 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f1a5d30f-b67a-4f38-96d3-37db1698e402" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:55 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d Nov 03 17:24:55 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-f1a5d30f-b67a-4f38-96d3-37db1698e402" released by "delete_volume" :: held 1.059s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Created reservations ['61393470-2f97-454b-a44c-9e74d7ca4f9a', 'f84fbb25-eb22-4fbd-a4ab-3424eef8660b', 'f0ecec8a-e913-4495-8d02-3cc70f4e2f3b', '92ad20e2-b819-4afe-b611-8e95aa4d03d9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43c1e634-8b0c-4f50-8cbc-5828e85afb64 req-8a18026a-0f9b-4126-a476-01ba54620ed4 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:55 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:55 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:55 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d" returned: 0 in 0.294s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:55 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info Nov 03 17:24:55 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:56 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Deleted volume successfully. Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f88a7dcb-88bb-40c8-b966-7d608b479875 tempest-VolumesTestJSON-320988493 None] Lock "cinder-f1a5d30f-b67a-4f38-96d3-37db1698e402-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:56 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:56 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:56 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info Nov 03 17:24:56 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:56 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.info" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Creating offline snapshot fd56ce88-c6fc-408f-bb7e-4f1c30303b33 of volume ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae96d60-1267-454b-b785-a37da3a36515]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:56 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 Nov 03 17:24:56 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-86b0571d-2cd8-49a0-9c68-90401ff2d77b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "cinder-86b0571d-2cd8-49a0-9c68-90401ff2d77b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-quobyte-86b0571d-2cd8-49a0-9c68-90401ff2d77b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-86b0571d-2cd8-49a0-9c68-90401ff2d77b" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e87061-fc6f-47e7-8aff-b47c13ba2408]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:56 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b Nov 03 17:24:56 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:56 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5" returned: 0 in 0.500s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:56 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 1G Nov 03 17:24:56 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:57 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:57 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b Nov 03 17:24:57 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:57 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 1G" returned: 0 in 0.484s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced23924-8288-479d-96f7-67521c57bdd5 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:57 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced23924-8288-479d-96f7-67521c57bdd5 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 Nov 03 17:24:57 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:57 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-86b0571d-2cd8-49a0-9c68-90401ff2d77b" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-86b0571d-2cd8-49a0-9c68-90401ff2d77b" released by "delete_volume" :: held 0.784s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Created reservations ['e2efc9b1-a856-48d1-a374-e20525930f1f', 'e90fc3a4-dfd0-46dd-b0c4-359319974d31', '8335298c-d426-4ef1-a3d7-c9bfb654fbdd', '212b49af-5348-43c3-810a-0fac6c6d7650'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:57 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:57 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:57 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced23924-8288-479d-96f7-67521c57bdd5 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33" returned: 0 in 0.371s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:57 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-6c71d474-757c-4704-bd67-03d8c36c6468-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:57 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 Nov 03 17:24:57 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "cinder-6c71d474-757c-4704-bd67-03d8c36c6468-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Acquiring lock "cinder-quobyte-6c71d474-757c-4704-bd67-03d8c36c6468" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:24:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-6c71d474-757c-4704-bd67-03d8c36c6468" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efcf537-cd8a-4cf7-bbfb-ee56177ea269]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:58 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Deleted volume successfully. Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-51796c17-6202-4f92-9cf7-0138aa583f8c tempest-VolumesTestJSON-320988493 None] Lock "cinder-86b0571d-2cd8-49a0-9c68-90401ff2d77b-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:58 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 Nov 03 17:24:58 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:58 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info Nov 03 17:24:58 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:58 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468" returned: 0 in 0.465s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:58 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info" returned: 0 in 0.289s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:58 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468 Nov 03 17:24:58 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:58 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info Nov 03 17:24:58 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:58 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.info" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43c1e634-8b0c-4f50-8cbc-5828e85afb64 req-8a18026a-0f9b-4126-a476-01ba54620ed4 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.101s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6c71d474-757c-4704-bd67-03d8c36c6468" returned: 0 in 0.323s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "cinder-quobyte-6c71d474-757c-4704-bd67-03d8c36c6468" released by "delete_volume" :: held 0.853s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43c1e634-8b0c-4f50-8cbc-5828e85afb64 req-8a18026a-0f9b-4126-a476-01ba54620ed4 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.788s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246048762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:24:54Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Creating volume 2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:24:58 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:24:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:58 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd 1073741824 Nov 03 17:24:58 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-43c1e634-8b0c-4f50-8cbc-5828e85afb64 req-8a18026a-0f9b-4126-a476-01ba54620ed4 tempest-AttachVolumeTestJSON-482886334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-e555443c-17e4-474d-8f52-c441f58420b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c0d1387-5c9b-4cb3-8350-269e435b07d8', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Created reservations ['573cd77e-d688-4ca7-a45c-c2a890f9ab85', '1f5594f9-b7ce-42ec-aafb-7a0db3b04561', '826e46d0-8aeb-4249-9b8c-7b1435c3891d', 'd5df0764-3bc1-4066-8b7f-bf81476d0592'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:24:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-43c1e634-8b0c-4f50-8cbc-5828e85afb64 req-8a18026a-0f9b-4126-a476-01ba54620ed4 tempest-AttachVolumeTestJSON-482886334 None] attachment_update completed successfully. Nov 03 17:24:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-34952c5f-b348-4041-b550-f71a40d44f49 tempest-GroupSnapshotsTest-321830584 None] group_snapshot 30434534-22c8-4e4e-bb26-cef62796afde: created successfully Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:59 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:24:59 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:59 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd 1073741824" returned: 0 in 0.719s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:24:59 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Nov 03 17:24:59 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd Nov 03 17:24:59 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.491s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:24:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Deleted volume successfully. Nov 03 17:24:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8a75facc-a228-47ba-9782-d09e2988b2b2 tempest-VolumesTestJSON-320988493 None] Lock "cinder-6c71d474-757c-4704-bd67-03d8c36c6468-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:00 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" returned: 0 in 0.510s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf92420c-aa31-4c7d-b29f-0bc80c33b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cf402f-3ba5-46ad-9f6f-22e7806b24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] group_snapshot 30434534-22c8-4e4e-bb26-cef62796afde: deleting Nov 03 17:25:00 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Volume volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd (2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd): created successfully Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cf402f-3ba5-46ad-9f6f-22e7806b24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (fb5ca1bf-683c-4e8e-b2f0-92dcb4f51861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] group_snapshot 30434534-22c8-4e4e-bb26-cef62796afde: deleting {{(pid=86995) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:25:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c04478fe-2e6e-4861-91e4-cf57bd5bdf46 tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-50334519-9379-40c0-8b2c-0bebda98b95d" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-50334519-9379-40c0-8b2c-0bebda98b95d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Deleting offline snapshot 50334519-9379-40c0-8b2c-0bebda98b95d of volume b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] snapshot_file for this snap is: volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[56438eb7-6e87-4c5a-bdef-92a8625c0c3b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:01 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d Nov 03 17:25:01 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:01 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d" returned: 0 in 0.734s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9c7da-20da-4db0-8331-54cc20f4b1bc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c878f8c3-459c-4a51-8027-9c1137ca0e34 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" by "attach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c878f8c3-459c-4a51-8027-9c1137ca0e34 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" acquired by "attach_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c878f8c3-459c-4a51-8027-9c1137ca0e34 tempest-VolumesActionsTest-477002262 None] Attaching volume 2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd to instance 460c23f0-36a3-496a-98ef-cf9d08b0ec11 at mountpoint /dev/vdb on host None. Nov 03 17:25:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c878f8c3-459c-4a51-8027-9c1137ca0e34 tempest-VolumesActionsTest-477002262 None] Attach volume completed successfully. Nov 03 17:25:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c878f8c3-459c-4a51-8027-9c1137ca0e34 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" released by "attach_volume" :: held 0.158s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:01 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 Nov 03 17:25:01 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:02 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866" returned: 0 in 0.817s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:02 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d Nov 03 17:25:02 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (fe7dcc6e-0e73-44fa-93d2-4ebac3ccd0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d83c3f8-4742-4cf5-b944-110b0e417dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d83c3f8-4742-4cf5-b944-110b0e417dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-11726303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e74310-97a6-4e7f-8038-f9cdfcff1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:03Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8480bbab-682a-40b2-8684-b64d2bddc8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8480bbab-682a-40b2-8684-b64d2bddc8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216fbf9-43e3-493e-962b-958ef1f96326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216fbf9-43e3-493e-962b-958ef1f96326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e74310-97a6-4e7f-8038-f9cdfcff1b30', 'volume_name': 'volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe0310a-b494-4610-b08f-3d220c7b760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe0310a-b494-4610-b08f-3d220c7b760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e5355-9205-44be-853b-faa54a2acdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:02 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Volume 44e74310-97a6-4e7f-8038-f9cdfcff1b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30', 'volume_size': 1} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-11726303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e74310-97a6-4e7f-8038-f9cdfcff1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259469b6e3434617baeb7eabc3a3a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:03Z,use_quota=True,user_id='f57843cf895f4f9a908ee4bbc0391ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Creating volume 44e74310-97a6-4e7f-8038-f9cdfcff1b30 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:02 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:02 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 1073741824 Nov 03 17:25:02 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:03 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d" returned: 0 in 0.763s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:03 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d Nov 03 17:25:03 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Terminate volume connection completed successfully. Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" by "detach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Detaching volume 2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd from instance 460c23f0-36a3-496a-98ef-cf9d08b0ec11. Nov 03 17:25:03 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 1073741824" returned: 0 in 0.756s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Detach volume completed successfully. Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-efbff6f6-fce5-435e-b1c4-b8f59f1ca85a tempest-VolumesActionsTest-277265693 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" released by "detach_volume" :: held 0.217s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:03 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 Nov 03 17:25:03 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:03 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866.50334519-9379-40c0-8b2c-0bebda98b95d" returned: 0 in 0.478s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-50334519-9379-40c0-8b2c-0bebda98b95d" released by "_delete_snapshot" :: held 2.986s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" released by "delete_snapshot" :: held 3.039s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-fd56ce88-c6fc-408f-bb7e-4f1c30303b33" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-fd56ce88-c6fc-408f-bb7e-4f1c30303b33" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Deleting offline snapshot fd56ce88-c6fc-408f-bb7e-4f1c30303b33 of volume ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] snapshot_file for this snap is: volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d716b-9334-4d0c-847d-1ae688f2f400]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-afd0aef5-9cd5-4892-bb26-6d942dc34603 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" by "detach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-afd0aef5-9cd5-4892-bb26-6d942dc34603 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-afd0aef5-9cd5-4892-bb26-6d942dc34603 tempest-VolumesActionsTest-477002262 None] Volume detach called, but volume not attached. Nov 03 17:25:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-afd0aef5-9cd5-4892-bb26-6d942dc34603 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:04 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 Nov 03 17:25:04 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:04 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30" returned: 0 in 0.527s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e5355-9205-44be-853b-faa54a2acdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23b8f02-7466-41a4-b852-1a50dcb0454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:04 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Volume volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 (44e74310-97a6-4e7f-8038-f9cdfcff1b30): created successfully Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23b8f02-7466-41a4-b852-1a50dcb0454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Flow 'volume_create_manager' (fe7dcc6e-0e73-44fa-93d2-4ebac3ccd0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-322cc47c-786b-4962-acba-3459e40ed56e tempest-AttachVolumeTestJSON-482886334 None] Created volume successfully. Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-quobyte-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "cinder-quobyte-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:04 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6a588-e6be-40ad-9851-a700f1517243]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33" returned: 0 in 0.531s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced23924-8288-479d-96f7-67521c57bdd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[962186d3-bb2e-4010-aef6-c8ab4e353ec4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:04 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd Nov 03 17:25:04 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:04 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 Nov 03 17:25:04 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:04 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" returned: 0 in 0.498s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:04 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd Nov 03 17:25:04 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:05 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5" returned: 0 in 0.705s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:05 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 Nov 03 17:25:05 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:05 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" returned: 0 in 0.597s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "cinder-quobyte-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd" released by "delete_volume" :: held 1.150s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Created reservations ['cd3da6a4-8f5f-4c3b-89ef-1e3b5dd0a218', '560c2472-914e-401c-a4c6-b7cbc1f8cc22', 'e42f2c0a-9a80-4dc6-8161-288e446bd013', '24442fcf-90e4-4709-876b-0848a22dc070'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:05 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33" returned: 0 in 0.503s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:05 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33 Nov 03 17:25:05 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:05 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:05 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:05 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5.fd56ce88-c6fc-408f-bb7e-4f1c30303b33" returned: 0 in 0.369s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:06 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.324s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-fd56ce88-c6fc-408f-bb7e-4f1c30303b33" released by "_delete_snapshot" :: held 2.264s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Deleted volume successfully. Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-dc236e36-63cd-4eba-bfa8-b40663b48e41 req-0c856dbc-0545-4013-875e-968c08b314ca tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-dc236e36-63cd-4eba-bfa8-b40663b48e41 req-0c856dbc-0545-4013-875e-968c08b314ca tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" released by "delete_snapshot" :: held 2.311s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-dc236e36-63cd-4eba-bfa8-b40663b48e41 req-0c856dbc-0545-4013-875e-968c08b314ca tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ec39944e-4eb1-419c-9105-ac496e2f3014 tempest-VolumesActionsTest-477002262 None] Lock "cinder-2d4aa16f-8c0e-4d0a-ae21-a7cde9fb03dd-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-dc236e36-63cd-4eba-bfa8-b40663b48e41 req-0c856dbc-0545-4013-875e-968c08b314ca tempest-AttachVolumeTestJSON-482886334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c20860c0-c6ba-4758-ab45-dee443bfa1b1', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:25:06 devstack cinder-volume[86995]: WARNING cinder.quota [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-833617260 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-833617260, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:06 devstack cinder-volume[86995]: WARNING cinder.quota [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-833617260 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-833617260, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-dc236e36-63cd-4eba-bfa8-b40663b48e41 req-0c856dbc-0545-4013-875e-968c08b314ca tempest-AttachVolumeTestJSON-482886334 None] attachment_update completed successfully. Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Created reservations ['18d5b5fb-3e7c-4c34-a917-48a37f9103ff', '8f9a46f6-24b6-4d0e-9e7d-ff8fcb429b74', '1524ff8b-02dd-4cc0-900e-ee2d0ee7cd62', '6f8ed592-e229-494c-ab4e-7211eae8dba8'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:06 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] Created reservations ['0a40cdfa-77a0-447d-921e-2b6c170a69cd', '4329effe-33d6-4602-b388-562e676951c6', '0f251fe1-33e0-4dc9-8eac-62010da66d95', 'ad6cde47-8ffd-4b5d-8656-932a4782167a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1c027af-e3ef-4b13-9175-dcc97e01b93f tempest-GroupSnapshotsTest-321830584 None] group_snapshot 30434534-22c8-4e4e-bb26-cef62796afde: deleted successfully Nov 03 17:25:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e67ebf-cee9-4991-ad82-37f8fafc53a5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:07 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 Nov 03 17:25:07 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:08 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866" returned: 0 in 0.637s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:08 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866 Nov 03 17:25:08 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:08 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b929a6dc-e7fc-4fda-8cd1-2bb648522866" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-b929a6dc-e7fc-4fda-8cd1-2bb648522866" released by "delete_volume" :: held 1.189s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef64e6-df0b-4796-af15-7ac8eacb3cda]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:09 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 Nov 03 17:25:09 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-8be0b8de-cfb4-4b1d-bf75-52b641801946 req-1d8f7871-ceab-43b6-85d3-2e6d2ef7dff6 tempest-AttachVolumeTestJSON-482886334 None] Terminate volume connection completed successfully. Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-8be0b8de-cfb4-4b1d-bf75-52b641801946 req-1d8f7871-ceab-43b6-85d3-2e6d2ef7dff6 tempest-AttachVolumeTestJSON-482886334 None] Deleting attachment 5c0d1387-5c9b-4cb3-8350-269e435b07d8. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:25:09 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5" returned: 0 in 0.471s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:09 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5 Nov 03 17:25:09 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:09 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ced23924-8288-479d-96f7-67521c57bdd5" returned: 0 in 0.322s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-ced23924-8288-479d-96f7-67521c57bdd5" released by "delete_volume" :: held 0.939s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:09 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Created reservations ['cf3688fe-bc3b-439b-943e-29f7066d3c3f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:09 devstack cinder-volume[86995]: WARNING cinder.quota [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-833617260 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-833617260, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Created reservations ['a2c6f193-698e-471b-9d6c-8cbbe668dc97', '84e3bbc1-8386-4bc9-aaa6-709707e800cc', '206a9d84-a3b1-4922-a135-2947c1bde6c5', '89f31961-6798-4f5f-ac57-640ee10ab862'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Created reservations ['e3045b29-d3b9-46a2-9767-129a29fe0d37', '056871e5-3a2f-4a3c-995a-1afb46c312c0', '1a966996-2b55-41f5-a8c7-ce8ec0b93906', 'dddda3ed-a682-41ae-bb6e-6fac861d640a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:10 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:10 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (cf8845b0-f941-4b3a-b63d-988646860680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065ceb72-4f4b-499e-98c1-8917077e8be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065ceb72-4f4b-499e-98c1-8917077e8be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796895389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53bbb54-474a-4f0f-9e0c-195246eca588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:11Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1605ef89-b295-44a0-8c47-c4c33dd0ac2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1605ef89-b295-44a0-8c47-c4c33dd0ac2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3361aac6-1663-4dca-8762-ec7c249e05ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3361aac6-1663-4dca-8762-ec7c249e05ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53bbb54-474a-4f0f-9e0c-195246eca588', 'volume_name': 'volume-c53bbb54-474a-4f0f-9e0c-195246eca588', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6636af-b7d5-453e-aa0d-d1c80d2f0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6636af-b7d5-453e-aa0d-d1c80d2f0780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8690ac-4d52-4b57-9c1b-9fbddc18ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:10 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Volume c53bbb54-474a-4f0f-9e0c-195246eca588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53bbb54-474a-4f0f-9e0c-195246eca588', 'volume_size': 1} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796895389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53bbb54-474a-4f0f-9e0c-195246eca588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:11Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Creating volume c53bbb54-474a-4f0f-9e0c-195246eca588 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:10 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:10 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 1073741824 Nov 03 17:25:10 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:10 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.416s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:10 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-03e1609e-cc7a-4858-8cd6-913180e1e2ca tempest-GroupSnapshotsTest-321830584 None] Delete group completed successfully. Nov 03 17:25:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-0e026c63-36a6-467f-b289-eb2c905b0613 req-e231a78e-54fe-4c98-9613-6afd97d7d5a7 tempest-AttachVolumeTestJSON-482886334 None] Terminate volume connection completed successfully. Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-0e026c63-36a6-467f-b289-eb2c905b0613 req-e231a78e-54fe-4c98-9613-6afd97d7d5a7 tempest-AttachVolumeTestJSON-482886334 None] Deleting attachment c20860c0-c6ba-4758-ab45-dee443bfa1b1. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:25:11 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 1073741824" returned: 0 in 0.699s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:11 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 Nov 03 17:25:11 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:11 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588" returned: 0 in 0.343s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8690ac-4d52-4b57-9c1b-9fbddc18ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53bbb54-474a-4f0f-9e0c-195246eca588', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b1d16-5080-4a18-9b1a-e4a33737c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:11 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Volume volume-c53bbb54-474a-4f0f-9e0c-195246eca588 (c53bbb54-474a-4f0f-9e0c-195246eca588): created successfully Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b1d16-5080-4a18-9b1a-e4a33737c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (cf8845b0-f941-4b3a-b63d-988646860680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a1f5513e-2f0b-4c8b-b683-ae044d269770 tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e63b1299-b9c7-4e8a-946e-a2b55e63b6de tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-1446793314: creating Nov 03 17:25:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e63b1299-b9c7-4e8a-946e-a2b55e63b6de tempest-GroupSnapshotsTest-321830584 None] Group tempest-GroupSnapshotsTest-Group-1446793314: created successfully Nov 03 17:25:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e63b1299-b9c7-4e8a-946e-a2b55e63b6de tempest-GroupSnapshotsTest-321830584 None] Create group completed successfully. Nov 03 17:25:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-c53bbb54-474a-4f0f-9e0c-195246eca588-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "cinder-c53bbb54-474a-4f0f-9e0c-195246eca588-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-quobyte-c53bbb54-474a-4f0f-9e0c-195246eca588" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-c53bbb54-474a-4f0f-9e0c-195246eca588" acquired by "delete_volume" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[160532a4-4c77-4568-81cb-3b1217e8db8d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:13 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 Nov 03 17:25:13 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:13 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588" returned: 0 in 0.497s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:13 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588 Nov 03 17:25:13 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (ec635e55-9f42-4cb0-b59f-e6f38acd2d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbdc6d5-3b4c-4aec-b067-fa994e8a72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbdc6d5-3b4c-4aec-b067-fa994e8a72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406837899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9217ad1d-c0c3-4e15-87e7-ae1878c18662,host='devstack@QuobyteHD#QuobyteHD',id=4ced348a-3281-4018-8ac3-af14b1405f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:14Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8213ec30-aff9-47ce-8259-eafb5c503d78),volume_type_id=8213ec30-aff9-47ce-8259-eafb5c503d78)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4d290c-98b7-40a4-8f29-7daf30281f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4d290c-98b7-40a4-8f29-7daf30281f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fe94d7-e1b5-4291-94a3-31de13863970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:14 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fe94d7-e1b5-4291-94a3-31de13863970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ced348a-3281-4018-8ac3-af14b1405f3d', 'volume_name': 'volume-4ced348a-3281-4018-8ac3-af14b1405f3d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7fd7b0-ddce-4f04-a4c9-fd99d020afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7fd7b0-ddce-4f04-a4c9-fd99d020afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba4e858-113e-4e9d-b489-63be49ce0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Volume 4ced348a-3281-4018-8ac3-af14b1405f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ced348a-3281-4018-8ac3-af14b1405f3d', 'volume_size': 1} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9217ad1d-c0c3-4e15-87e7-ae1878c18662,created_at=2026-11-03T16:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406837899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9217ad1d-c0c3-4e15-87e7-ae1878c18662,host='devstack@QuobyteHD#QuobyteHD',id=4ced348a-3281-4018-8ac3-af14b1405f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff3dcfa7a554f039fea190a57c62b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:14Z,use_quota=True,user_id='9110547fa7f84825aba0e096b839bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8213ec30-aff9-47ce-8259-eafb5c503d78),volume_type_id=8213ec30-aff9-47ce-8259-eafb5c503d78)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Creating volume 4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c53bbb54-474a-4f0f-9e0c-195246eca588" returned: 0 in 0.642s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-c53bbb54-474a-4f0f-9e0c-195246eca588" released by "delete_volume" :: held 1.234s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:14 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d 1073741824 Nov 03 17:25:14 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Created reservations ['f26ef119-b4d3-4e83-86ae-19d5bb980061', 'd8b15e1a-751b-41aa-b015-edd91739a9f1', 'd6538c57-bfec-4336-88d1-53a86754d1bb', '7e5ff214-5b65-4c8f-bcdb-0dd74099d3dc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:14 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:14 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:14 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.347s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Deleted volume successfully. Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8da5ad6f-b213-4309-93a5-30d6437e12ac tempest-VolumesActionsTest-277265693 None] Lock "cinder-c53bbb54-474a-4f0f-9e0c-195246eca588-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:14 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d 1073741824" returned: 0 in 0.658s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:14 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d Nov 03 17:25:14 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:15 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba4e858-113e-4e9d-b489-63be49ce0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ced348a-3281-4018-8ac3-af14b1405f3d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df498275-b54e-41d6-b8c6-ae348f1af122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Volume volume-4ced348a-3281-4018-8ac3-af14b1405f3d (4ced348a-3281-4018-8ac3-af14b1405f3d): created successfully Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df498275-b54e-41d6-b8c6-ae348f1af122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Flow 'volume_create_manager' (ec635e55-9f42-4cb0-b59f-e6f38acd2d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2b812b53-eec5-489c-ab26-2794dc41a7f6 tempest-GroupSnapshotsTest-321830584 None] Created volume successfully. Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (6fe3356c-0f4e-4ca1-8bfb-f95b063f0cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96a6419-c2d3-48d3-bec8-e6859a08bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96a6419-c2d3-48d3-bec8-e6859a08bc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2131445432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1241bc9d-5c00-433f-a05f-b3aef55b100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:16Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c02e8b6-6cc4-4b52-97d6-c7ebe9f1a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c02e8b6-6cc4-4b52-97d6-c7ebe9f1a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b4052d-bf2d-4af8-95fa-25a5da84eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b4052d-bf2d-4af8-95fa-25a5da84eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1241bc9d-5c00-433f-a05f-b3aef55b100d', 'volume_name': 'volume-1241bc9d-5c00-433f-a05f-b3aef55b100d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35408845-f19d-4d2f-866f-040c9a8d397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35408845-f19d-4d2f-866f-040c9a8d397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100c2d7-42e2-4465-a983-f97be0d15e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Volume 1241bc9d-5c00-433f-a05f-b3aef55b100d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1241bc9d-5c00-433f-a05f-b3aef55b100d', 'volume_size': 1} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2131445432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1241bc9d-5c00-433f-a05f-b3aef55b100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:16Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Creating volume 1241bc9d-5c00-433f-a05f-b3aef55b100d {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:16 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:16 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d 1073741824 Nov 03 17:25:16 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:16 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d 1073741824" returned: 0 in 0.559s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:16 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d Nov 03 17:25:16 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] GroupSnapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: creating. Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Group snapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: creating. {{(pid=86995) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:25:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:17 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100c2d7-42e2-4465-a983-f97be0d15e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1241bc9d-5c00-433f-a05f-b3aef55b100d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a094f-5abc-4b90-b025-67991d5df04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Creating offline snapshot 86b19eb1-91a3-40f9-ac3f-3153b5f74cdd of volume 4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:25:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Volume volume-1241bc9d-5c00-433f-a05f-b3aef55b100d (1241bc9d-5c00-433f-a05f-b3aef55b100d): created successfully Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a094f-5abc-4b90-b025-67991d5df04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (6fe3356c-0f4e-4ca1-8bfb-f95b063f0cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bdcce0-3674-430f-8881-28e36a827c09]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-88bfcf11-59f4-44a5-bab0-d6396aa0153c tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6dc1937d-e143-4c03-a186-c3ce35155381 tempest-GroupsV314Test-2060595975 None] Group tempest-GroupsV314Test-Group-796252877: creating Nov 03 17:25:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6dc1937d-e143-4c03-a186-c3ce35155381 tempest-GroupsV314Test-2060595975 None] Group tempest-GroupsV314Test-Group-796252877: created successfully Nov 03 17:25:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6dc1937d-e143-4c03-a186-c3ce35155381 tempest-GroupsV314Test-2060595975 None] Create group completed successfully. Nov 03 17:25:17 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d Nov 03 17:25:17 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:17 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d" returned: 0 in 0.402s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:17 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd 1G Nov 03 17:25:17 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-44e74310-97a6-4e7f-8038-f9cdfcff1b30-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-44e74310-97a6-4e7f-8038-f9cdfcff1b30-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-quobyte-44e74310-97a6-4e7f-8038-f9cdfcff1b30" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-44e74310-97a6-4e7f-8038-f9cdfcff1b30" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[886908b2-f111-480e-9dda-0241187add51]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 Nov 03 17:25:18 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd 1G" returned: 0 in 0.461s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ced348a-3281-4018-8ac3-af14b1405f3d -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ced348a-3281-4018-8ac3-af14b1405f3d -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd Nov 03 17:25:18 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-1241bc9d-5c00-433f-a05f-b3aef55b100d-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "cinder-1241bc9d-5c00-433f-a05f-b3aef55b100d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:18 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30" returned: 0 in 0.462s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30 Nov 03 17:25:18 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-quobyte-1241bc9d-5c00-433f-a05f-b3aef55b100d" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:18 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-1241bc9d-5c00-433f-a05f-b3aef55b100d" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ced348a-3281-4018-8ac3-af14b1405f3d -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" returned: 0 in 0.370s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:18 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abc21e-e7dc-4bca-b803-4845a425935d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd Nov 03 17:25:18 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d Nov 03 17:25:18 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44e74310-97a6-4e7f-8038-f9cdfcff1b30" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-44e74310-97a6-4e7f-8038-f9cdfcff1b30" released by "delete_volume" :: held 0.815s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:18 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" returned: 0 in 0.299s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Created reservations ['5aa15474-bee3-48f7-b765-78a5a2a40a7b', 'edc79a1c-2420-4f04-8c44-9aea5656a2b3', '026aaeca-addc-4fa3-819f-62b2058e820a', '3da3112a-a52d-4f36-9f93-089e3c9f5917'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info Nov 03 17:25:18 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:18 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:18 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-e555443c-17e4-474d-8f52-c441f58420b4-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d" returned: 0 in 0.613s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d Nov 03 17:25:19 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-e555443c-17e4-474d-8f52-c441f58420b4-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:19 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info Nov 03 17:25:19 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Flow 'volume_create_manager' (b754439a-6ab9-484a-a9ae-ebdf4babacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba724b7b-b0c4-4794-88bd-a63bc311e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-quobyte-e555443c-17e4-474d-8f52-c441f58420b4" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba724b7b-b0c4-4794-88bd-a63bc311e818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1855361755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb9a5217-1ea7-4ccd-bfeb-c69af8fa8ea8,host='devstack@QuobyteHD#QuobyteHD',id=beb5c94c-0080-4426-8a43-44b4dc85630b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f455c0b0c345a2b3c62e84e28a9607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:19Z,use_quota=True,user_id='0873a66e153f46abb9be91a91dcdc27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a8e5f21-047e-4615-a45c-f4366c7bd118),volume_type_id=7a8e5f21-047e-4615-a45c-f4366c7bd118)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420322b8-e6c7-4b68-a8f8-44280fbd78c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420322b8-e6c7-4b68-a8f8-44280fbd78c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5e37fc-7499-4078-8aea-5bc7f6cf72f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5e37fc-7499-4078-8aea-5bc7f6cf72f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb5c94c-0080-4426-8a43-44b4dc85630b', 'volume_name': 'volume-beb5c94c-0080-4426-8a43-44b4dc85630b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a774f5-ffce-4bf8-b50b-cf346c350638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a774f5-ffce-4bf8-b50b-cf346c350638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:19 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f07da-0541-4efb-902d-f7172f02a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Volume beb5c94c-0080-4426-8a43-44b4dc85630b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb5c94c-0080-4426-8a43-44b4dc85630b', 'volume_size': 1} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.444s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Deleted volume successfully. Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-e555443c-17e4-474d-8f52-c441f58420b4" acquired by "delete_volume" :: waited 0.082s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:19 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1241bc9d-5c00-433f-a05f-b3aef55b100d" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0000f75e-6666-4950-b974-90f78abbf1c4 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-44e74310-97a6-4e7f-8038-f9cdfcff1b30-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db1f0f7-a08f-4c28-9446-fb83b7e2f251]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-1241bc9d-5c00-433f-a05f-b3aef55b100d" released by "delete_volume" :: held 0.989s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Created reservations ['d3cc6bf3-64fd-4747-a93a-2c906297e003', 'fbce0864-f5b5-4b4f-b396-2c20ca8206b1', 'f6728f45-da13-4e74-8945-805b4dd99b38', 'f1af6045-e436-456d-a0a1-58deb80a1dea'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:19 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.info" returned: 0 in 0.333s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 Nov 03 17:25:19 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb9a5217-1ea7-4ccd-bfeb-c69af8fa8ea8,created_at=2026-11-03T16:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1855361755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb9a5217-1ea7-4ccd-bfeb-c69af8fa8ea8,host='devstack@QuobyteHD#QuobyteHD',id=beb5c94c-0080-4426-8a43-44b4dc85630b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f455c0b0c345a2b3c62e84e28a9607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:19Z,use_quota=True,user_id='0873a66e153f46abb9be91a91dcdc27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a8e5f21-047e-4615-a45c-f4366c7bd118),volume_type_id=7a8e5f21-047e-4615-a45c-f4366c7bd118)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Creating volume beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:19 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b 1073741824 Nov 03 17:25:19 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:19 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-263cb831-e60c-45c6-a2e7-6fc281eb1ea9 tempest-GroupSnapshotsTest-321830584 None] group_snapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: created successfully Nov 03 17:25:19 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4" returned: 0 in 0.495s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:19 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:19 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4 Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:19 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:19 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Deleted volume successfully. Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e509b634-2e15-436d-8d74-d043499cb4e5 tempest-VolumesActionsTest-277265693 None] Lock "cinder-1241bc9d-5c00-433f-a05f-b3aef55b100d-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:20 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b 1073741824" returned: 0 in 0.558s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:20 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e555443c-17e4-474d-8f52-c441f58420b4" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:20 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:20 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-e555443c-17e4-474d-8f52-c441f58420b4" released by "delete_volume" :: held 0.867s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] group_snapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: deleting Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Created reservations ['57570a2e-4391-4a99-9107-6fb3daba041c', '0b95ab8e-8666-4e1e-924a-ea60a29e1634', '0f899b8e-32d6-4687-9e30-a7a2de4e9781', '6b178523-3a68-473c-b2ba-51bb7d40105a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] group_snapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: deleting {{(pid=86995) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Deleting offline snapshot 86b19eb1-91a3-40f9-ac3f-3153b5f74cdd of volume 4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:25:20 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:20 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] snapshot_file for this snap is: volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e38f99-fd00-412c-bdaa-4265ff21d446]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:20 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f07da-0541-4efb-902d-f7172f02a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb5c94c-0080-4426-8a43-44b4dc85630b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e788841-b322-4588-99a3-473aa24b8a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Volume volume-beb5c94c-0080-4426-8a43-44b4dc85630b (beb5c94c-0080-4426-8a43-44b4dc85630b): created successfully Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e788841-b322-4588-99a3-473aa24b8a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Flow 'volume_create_manager' (b754439a-6ab9-484a-a9ae-ebdf4babacaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:20 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd Nov 03 17:25:20 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-28bc416c-0c14-4076-8845-9df08e9c9b7d tempest-GroupsV314Test-2060595975 None] Created volume successfully. Nov 03 17:25:20 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Deleted volume successfully. Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3ee32c6b-7781-4bd9-a630-5ef55c71d04c tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-e555443c-17e4-474d-8f52-c441f58420b4-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:20 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" returned: 0 in 0.463s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ced348a-3281-4018-8ac3-af14b1405f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c64659-02c1-47b8-afd3-6a5eae506630]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:21 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d Nov 03 17:25:21 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (9f1b8580-7488-4f64-ac47-1e8f5bf62e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564d7690-f228-44d1-869f-bffab7cf0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564d7690-f228-44d1-869f-bffab7cf0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915914960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63439942-2085-420f-bd65-f124652022d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:21Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eb049c-2da4-4d82-8827-c3cf398df875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eb049c-2da4-4d82-8827-c3cf398df875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37287dad-4393-4356-b3d4-8be23fe62ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37287dad-4393-4356-b3d4-8be23fe62ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63439942-2085-420f-bd65-f124652022d8', 'volume_name': 'volume-63439942-2085-420f-bd65-f124652022d8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df9a4d-ff45-464c-96fe-2e5d046a9be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df9a4d-ff45-464c-96fe-2e5d046a9be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4793ceb5-7252-41ed-b164-6d4d95c779e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:21 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Volume 63439942-2085-420f-bd65-f124652022d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63439942-2085-420f-bd65-f124652022d8', 'volume_size': 1} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915914960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63439942-2085-420f-bd65-f124652022d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:21Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Creating volume 63439942-2085-420f-bd65-f124652022d8 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:21 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:21 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 1073741824 Nov 03 17:25:21 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-bf33e606-178d-42e5-b57c-f0ca6c886ccb-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-bf33e606-178d-42e5-b57c-f0ca6c886ccb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:21 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d" returned: 0 in 0.524s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:21 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd Nov 03 17:25:21 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "cinder-quobyte-bf33e606-178d-42e5-b57c-f0ca6c886ccb" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-bf33e606-178d-42e5-b57c-f0ca6c886ccb" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fbc02b-ae81-4a6c-8217-bdef3fbee07b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:21 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb Nov 03 17:25:21 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:22 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 1073741824" returned: 0 in 0.719s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" returned: 0 in 0.578s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:22 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd Nov 03 17:25:22 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:22 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 Nov 03 17:25:22 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:22 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb" returned: 0 in 0.659s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:22 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb Nov 03 17:25:22 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:22 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d.86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" returned: 0 in 0.460s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8" returned: 0 in 0.445s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-86b19eb1-91a3-40f9-ac3f-3153b5f74cdd" released by "_delete_snapshot" :: held 2.199s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:22 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Cloning volume beb5c94c-0080-4426-8a43-44b4dc85630b to volume 40eb68f3-91a0-4392-b400-086ccb73e38c Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" released by "delete_snapshot" :: held 2.289s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4793ceb5-7252-41ed-b164-6d4d95c779e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63439942-2085-420f-bd65-f124652022d8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fda29b-286d-47e4-be1b-7de9668739ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:22 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Volume volume-63439942-2085-420f-bd65-f124652022d8 (63439942-2085-420f-bd65-f124652022d8): created successfully Nov 03 17:25:22 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fda29b-286d-47e4-be1b-7de9668739ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (9f1b8580-7488-4f64-ac47-1e8f5bf62e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Creating offline snapshot 8a8dd991-83d6-4c26-af01-23839e7d1e02 of volume beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bf33e606-178d-42e5-b57c-f0ca6c886ccb" returned: 0 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b7729ea6-ad7d-4f70-a8d8-f1b304a5f114 tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8970fe5-0189-4c07-a2ef-607696847aff]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-quobyte-bf33e606-178d-42e5-b57c-f0ca6c886ccb" released by "delete_volume" :: held 1.280s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:23 devstack cinder-volume[86995]: WARNING cinder.quota [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-18893913 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-18893913, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:23 devstack cinder-volume[86995]: WARNING cinder.quota [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-18893913 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-18893913, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Created reservations ['14834584-64a1-42db-be27-ec9dd593f666', '5a865f29-99a4-4a2f-ba00-fc2ec3a154a2', 'cb35b855-d80f-4584-a106-b363286120ab', 'c985fa79-5cbb-432e-9907-c12dac8a6958'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['bad87a7e-1b1d-4b4b-8bda-30649bde9db8', '68dcb8cc-3869-4fd2-a5f8-a9a46d781320', '63ed16da-68a3-4e5f-a74f-a8b030ef8a4e', 'd90977ca-c64e-4113-8bde-941b9866c702'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:23 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:23 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:23 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:23 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-14cd86b5-3292-49bf-9b9c-164443a03e13 tempest-GroupSnapshotsTest-321830584 None] group_snapshot 571dfdb4-c070-40ee-abdb-5850fafe6eee: deleted successfully Nov 03 17:25:23 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.423s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:23 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 1G Nov 03 17:25:23 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:23 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Deleted volume successfully. Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d980c3cd-4e8c-47a9-8bd1-222b9bba52a1 tempest-AttachVolumeTestJSON-482886334 None] Lock "cinder-bf33e606-178d-42e5-b57c-f0ca6c886ccb-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-63439942-2085-420f-bd65-f124652022d8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "cinder-63439942-2085-420f-bd65-f124652022d8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-quobyte-63439942-2085-420f-bd65-f124652022d8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-63439942-2085-420f-bd65-f124652022d8" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86f02e5-787f-423d-b269-00e32e205a1b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:23 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 Nov 03 17:25:23 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:23 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 1G" returned: 0 in 0.478s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb5c94c-0080-4426-8a43-44b4dc85630b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:23 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb5c94c-0080-4426-8a43-44b4dc85630b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:23 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8" returned: 0 in 0.456s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8 Nov 03 17:25:24 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:24 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb5c94c-0080-4426-8a43-44b4dc85630b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.442s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:24 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b12acb9-7c1c-4cf3-9de5-f93f38ed3ce8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:24 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d Nov 03 17:25:24 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-63439942-2085-420f-bd65-f124652022d8" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-63439942-2085-420f-bd65-f124652022d8" released by "delete_volume" :: held 0.892s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Created reservations ['93827898-b845-4096-b39b-585dd38f07d3', '82bb6e66-b4c8-4222-98f5-16fe04fe57ce', '5edf029f-b3ca-4a5c-a1d3-aad42824a80d', '843fca17-2573-4b0d-a495-19f2b4044988'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:24 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info Nov 03 17:25:24 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:24 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:24 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d" returned: 0 in 0.485s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:24 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d Nov 03 17:25:24 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:25 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info" returned: 0 in 0.321s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:25 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:25 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info Nov 03 17:25:25 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.379s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:25 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:25 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Deleted volume successfully. Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7681cdf1-8e2f-43fc-9e60-fff92a59bbbc tempest-VolumesActionsTest-277265693 None] Lock "cinder-63439942-2085-420f-bd65-f124652022d8-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:25 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ced348a-3281-4018-8ac3-af14b1405f3d" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Lock "cinder-quobyte-4ced348a-3281-4018-8ac3-af14b1405f3d" released by "delete_volume" :: held 1.054s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['6295ba1c-d16b-4c5b-b8c9-10cf5c0b9d1d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:25 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.info" returned: 0 in 0.462s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Acquiring lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:25 devstack cinder-volume[86995]: WARNING cinder.quota [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-18893913 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-18893913, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (4c1c3150-525b-4fb6-b58c-354057c8ae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81507cf6-c27d-442e-a71d-449646438169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" acquired by "_copy_volume_from_snapshot" :: waited 0.090s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] snapshot: 8a8dd991-83d6-4c26-af01-23839e7d1e02, volume: 40eb68f3-91a0-4392-b400-086ccb73e38c, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Created reservations ['b65c406c-07df-495a-af29-d0ec61e937dc', '6fc9cf09-a710-4cd0-acb5-cb3913682ec4', '4bae1f98-5326-4b90-95fe-cc4e165c8df3', '4cef1d15-bb81-45c7-9548-e044582fb9c0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[540776a1-3b04-4bd0-93f8-f366f2aa244c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81507cf6-c27d-442e-a71d-449646438169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48264778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1479efdc-33b1-4964-a500-4be7a0da4e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:25Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e48da-cd6b-4392-9b31-595c80f3049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e48da-cd6b-4392-9b31-595c80f3049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0311f5b3-5f5f-4201-b3fd-f78e06d6d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0311f5b3-5f5f-4201-b3fd-f78e06d6d917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1479efdc-33b1-4964-a500-4be7a0da4e71', 'volume_name': 'volume-1479efdc-33b1-4964-a500-4be7a0da4e71', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f214c70c-6370-4b1b-96b6-384776ea955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f214c70c-6370-4b1b-96b6-384776ea955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb8f3c6-5a02-49c9-abfd-5f91ed6f8c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:25 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Volume 1479efdc-33b1-4964-a500-4be7a0da4e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1479efdc-33b1-4964-a500-4be7a0da4e71', 'volume_size': 1} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:25 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:25 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:25 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:25 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:26 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb5c94c-0080-4426-8a43-44b4dc85630b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6f7b8-0f61-4d1b-8ebb-11e2a360b816]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:26 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-685e3023-4ab7-4d28-b71e-8d2acb730011 tempest-GroupSnapshotsTest-321830584 None] Delete group completed successfully. Nov 03 17:25:26 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:26 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:26 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:25:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:26 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c Nov 03 17:25:26 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:34 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c" returned: 0 in 8.167s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:25:34 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Converted 1024.00 MB image at 125.35 MB/s Nov 03 17:25:34 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:34 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c Nov 03 17:25:34 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:34 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" released by "_copy_volume_from_snapshot" :: held 9.344s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=234,cinder:SELECT=206,cinder:INSERT=55,cinder:DELETE=13 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:25:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Acquiring lock "cinder-quobyte-8a8dd991-83d6-4c26-af01-23839e7d1e02" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-8a8dd991-83d6-4c26-af01-23839e7d1e02" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Deleting offline snapshot 8a8dd991-83d6-4c26-af01-23839e7d1e02 of volume beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] snapshot_file for this snap is: volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f06860-ae6a-4447-a864-a9c9535f9f42]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:35 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:35 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:35 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.422s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb5c94c-0080-4426-8a43-44b4dc85630b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff454929-0058-4779-a63d-a62e6d5cb566]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:35 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:35 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:35 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=229,cinder:SELECT=216,cinder:INSERT=55,cinder:DELETE=12 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:25:36 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.602s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:36 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:36 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:36 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.385s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:36 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02 Nov 03 17:25:36 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:36 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b.8a8dd991-83d6-4c26-af01-23839e7d1e02" returned: 0 in 0.337s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-8a8dd991-83d6-4c26-af01-23839e7d1e02" released by "_delete_snapshot" :: held 1.909s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.252s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.205s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48264778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1479efdc-33b1-4964-a500-4be7a0da4e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:25Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Creating volume 1479efdc-33b1-4964-a500-4be7a0da4e71 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:36 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:36 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 1073741824 Nov 03 17:25:36 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3c92fbce-88da-47d0-b118-40a250d79c5a tempest-GroupsV314Test-2060595975 None] Create group from source-group-eb9a5217-1ea7-4ccd-bfeb-c69af8fa8ea8 completed successfully. Nov 03 17:25:37 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 1073741824" returned: 0 in 0.542s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:37 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 Nov 03 17:25:37 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:37 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb8f3c6-5a02-49c9-abfd-5f91ed6f8c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1479efdc-33b1-4964-a500-4be7a0da4e71', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c555e2de-54f8-48de-9963-c8f720beee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:37 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Volume volume-1479efdc-33b1-4964-a500-4be7a0da4e71 (1479efdc-33b1-4964-a500-4be7a0da4e71): created successfully Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c555e2de-54f8-48de-9963-c8f720beee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (4c1c3150-525b-4fb6-b58c-354057c8ae00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-43463327-edf9-402a-b828-8efc5b84eabb tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Acquiring lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d52f0-068e-41dd-814a-9fb1e5820f83]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:38 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c Nov 03 17:25:38 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:38 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:38 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:39 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:25:39 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c" returned: 0 in 0.733s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:39 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c Nov 03 17:25:39 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-1479efdc-33b1-4964-a500-4be7a0da4e71-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "cinder-1479efdc-33b1-4964-a500-4be7a0da4e71-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Acquiring lock "cinder-quobyte-1479efdc-33b1-4964-a500-4be7a0da4e71" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-1479efdc-33b1-4964-a500-4be7a0da4e71" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c803d1f6-e218-4b8e-82c5-008325a2ac4a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:39 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-40eb68f3-91a0-4392-b400-086ccb73e38c" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-40eb68f3-91a0-4392-b400-086ccb73e38c" released by "delete_volume" :: held 1.168s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Created reservations ['c3710b0c-14f5-4635-8267-3826febdcfe3'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:39 devstack cinder-volume[86995]: WARNING cinder.quota [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1983952249 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1983952249, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:39 devstack cinder-volume[86995]: WARNING cinder.quota [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1983952249 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1983952249, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:39 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 Nov 03 17:25:39 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Created reservations ['4d7330f5-6053-478e-9e39-a346f858ae68', '9fc0049f-ec43-407e-8f5b-31fcdc9cc796', '4e8c3c4d-2dbd-4b7d-b55b-98433034d8d7', 'ad64c644-1335-40b5-bc99-2b7f2c1597f2'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:40 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:40 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:40 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71" returned: 0 in 0.515s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:40 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71 Nov 03 17:25:40 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:40 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-53a9049f-06aa-4339-a82f-20d36d4ddeb9 tempest-GroupsV314Test-2060595975 None] Delete group completed successfully. Nov 03 17:25:40 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1479efdc-33b1-4964-a500-4be7a0da4e71" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "cinder-quobyte-1479efdc-33b1-4964-a500-4be7a0da4e71" released by "delete_volume" :: held 0.829s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Created reservations ['0e9f75bc-314e-419d-94b1-74010fccef94', 'a8596673-0e2f-4425-87c0-905d71ae1490', '2f046dfb-7d00-469c-b353-c5169533da3f', '73b2e4d5-e8ed-43fd-8dd1-db2f053b9959'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:40 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:40 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:41 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.306s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Deleted volume successfully. Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-53ebacab-74c8-468f-b1e2-95dc282469d7 tempest-VolumesActionsTest-277265693 None] Lock "cinder-1479efdc-33b1-4964-a500-4be7a0da4e71-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Acquiring lock "cinder-quobyte-beb5c94c-0080-4426-8a43-44b4dc85630b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (feaf7a47-74d7-4944-9759-d691fa418b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc86666a-65f5-4085-8bf4-dbfe69f8b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-beb5c94c-0080-4426-8a43-44b4dc85630b" acquired by "delete_volume" :: waited 0.105s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc86666a-65f5-4085-8bf4-dbfe69f8b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019097567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa78877-c1a2-4d22-b866-af9e41b31b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:42Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cba732d-c7b7-4b8a-8d3d-e723906c1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cba732d-c7b7-4b8a-8d3d-e723906c1c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cc5b6d-0d77-4dc0-9fd3-d246f61f4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cc5b6d-0d77-4dc0-9fd3-d246f61f4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa78877-c1a2-4d22-b866-af9e41b31b4b', 'volume_name': 'volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b97d319-dda5-4d60-9553-bcb2302d2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b97d319-dda5-4d60-9553-bcb2302d2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8144623-bf5f-4973-ac45-f9276e86c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Volume 9fa78877-c1a2-4d22-b866-af9e41b31b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b', 'volume_size': 1} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019097567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa78877-c1a2-4d22-b866-af9e41b31b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e0e27b4be4a0ea894e8a7bfc92db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:42Z,use_quota=True,user_id='d1c5fc0f85b64ee2a105a55e59900efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Creating volume 9fa78877-c1a2-4d22-b866-af9e41b31b4b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:41 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2e35d-e54e-4cf4-956a-5b13de1ab990]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:41 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b 1073741824 Nov 03 17:25:41 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:42 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:42 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:42 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.497s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:42 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b Nov 03 17:25:42 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:42 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b 1073741824" returned: 0 in 0.568s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:42 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b Nov 03 17:25:42 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:42 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-beb5c94c-0080-4426-8a43-44b4dc85630b" returned: 0 in 0.321s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Lock "cinder-quobyte-beb5c94c-0080-4426-8a43-44b4dc85630b" released by "delete_volume" :: held 1.022s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:42 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b" returned: 0 in 0.318s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8144623-bf5f-4973-ac45-f9276e86c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ef5d96-627d-40b3-b834-866dd3468e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Created reservations ['080095e7-d50d-4775-a70d-ae4450b284f9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Volume volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b (9fa78877-c1a2-4d22-b866-af9e41b31b4b): created successfully Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ef5d96-627d-40b3-b834-866dd3468e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Flow 'volume_create_manager' (feaf7a47-74d7-4944-9759-d691fa418b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-62dafa39-b468-4e4a-95db-51a5505ac735 tempest-VolumesActionsTest-477002262 None] Created volume successfully. Nov 03 17:25:42 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Created reservations ['420590c7-f871-4249-8eaa-2ba676b34b5d', 'f6594842-c1ae-4373-8b39-2c1f35eb81f3', 'ce613847-3dee-49b3-a1f7-f2c226f81707', '34bb938a-0707-43f2-86a9-36a8bb673462'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:43 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:43 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:43 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:43 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-30c28fe2-872d-4992-a5a3-4489939266ea tempest-GroupsV314Test-2060595975 None] Delete group completed successfully. Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-9fa78877-c1a2-4d22-b866-af9e41b31b4b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "cinder-9fa78877-c1a2-4d22-b866-af9e41b31b4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Acquiring lock "cinder-quobyte-9fa78877-c1a2-4d22-b866-af9e41b31b4b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "cinder-quobyte-9fa78877-c1a2-4d22-b866-af9e41b31b4b" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f693ed-35a3-4461-86d8-1717f9f03e9e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:44 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b Nov 03 17:25:44 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:45 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b" returned: 0 in 0.599s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:45 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b Nov 03 17:25:45 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:45 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9fa78877-c1a2-4d22-b866-af9e41b31b4b" returned: 0 in 0.354s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "cinder-quobyte-9fa78877-c1a2-4d22-b866-af9e41b31b4b" released by "delete_volume" :: held 1.060s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Created reservations ['0f795646-be1a-443b-9bf5-b563c836e796', 'bf5492fa-e759-448c-927a-ca8be0c55cbb', '6b9057df-fa1e-453a-9906-ead246cc8b0b', 'c850ae65-aad6-4a57-b241-1fd089982d88'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:45 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:45 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:46 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.399s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:46 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Deleted volume successfully. Nov 03 17:25:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a23775df-38bb-4db7-8460-4d20c26eba86 tempest-VolumesActionsTest-477002262 None] Lock "cinder-9fa78877-c1a2-4d22-b866-af9e41b31b4b-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9c9ba24e-a2e4-4131-afe9-3b939710ebbb tempest-GroupsTest-1757460556 None] Group tempest-Group1-1072874099: creating Nov 03 17:25:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9c9ba24e-a2e4-4131-afe9-3b939710ebbb tempest-GroupsTest-1757460556 None] Group tempest-Group1-1072874099: created successfully Nov 03 17:25:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9c9ba24e-a2e4-4131-afe9-3b939710ebbb tempest-GroupsTest-1757460556 None] Create group completed successfully. Nov 03 17:25:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-68f8328d-0a56-43fc-b690-1e485d8ce92e tempest-GroupsTest-1757460556 None] Group tempest-Group2-1681042026: creating Nov 03 17:25:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-68f8328d-0a56-43fc-b690-1e485d8ce92e tempest-GroupsTest-1757460556 None] Group tempest-Group2-1681042026: created successfully Nov 03 17:25:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-68f8328d-0a56-43fc-b690-1e485d8ce92e tempest-GroupsTest-1757460556 None] Create group completed successfully. Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (1ac891dc-8bf5-46a4-a58e-3e32681b835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1226b24d-529c-48ca-90f7-9bf6aa3c1b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1226b24d-529c-48ca-90f7-9bf6aa3c1b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55891442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac5e46f3-1983-4779-b1f0-1a0003483517,host='devstack@QuobyteHD#QuobyteHD',id=c32048bb-6b1e-41de-848c-3a7af18b3f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:50Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8eb6a13-f76c-451b-acba-2941d53bcc01),volume_type_id=a8eb6a13-f76c-451b-acba-2941d53bcc01)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b360ad39-8a4d-4871-902a-8d290031fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b360ad39-8a4d-4871-902a-8d290031fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f500a532-086d-44a1-811f-46819d240195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f500a532-086d-44a1-811f-46819d240195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32048bb-6b1e-41de-848c-3a7af18b3f05', 'volume_name': 'volume-c32048bb-6b1e-41de-848c-3a7af18b3f05', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9358480-b2ae-4bff-9c18-76b6e799a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9358480-b2ae-4bff-9c18-76b6e799a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b6c86f-3a70-4352-8647-fbdbd8157e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:49 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Volume c32048bb-6b1e-41de-848c-3a7af18b3f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32048bb-6b1e-41de-848c-3a7af18b3f05', 'volume_size': 1} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac5e46f3-1983-4779-b1f0-1a0003483517,created_at=2026-11-03T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55891442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac5e46f3-1983-4779-b1f0-1a0003483517,host='devstack@QuobyteHD#QuobyteHD',id=c32048bb-6b1e-41de-848c-3a7af18b3f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:50Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8eb6a13-f76c-451b-acba-2941d53bcc01),volume_type_id=a8eb6a13-f76c-451b-acba-2941d53bcc01)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Creating volume c32048bb-6b1e-41de-848c-3a7af18b3f05 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:49 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:49 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 1073741824 Nov 03 17:25:49 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:50 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 1073741824" returned: 0 in 0.701s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:50 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 Nov 03 17:25:50 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:50 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05" returned: 0 in 0.370s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b6c86f-3a70-4352-8647-fbdbd8157e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32048bb-6b1e-41de-848c-3a7af18b3f05', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eef1d2f-8429-4d43-bc37-cfb1e830c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:51 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Volume volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 (c32048bb-6b1e-41de-848c-3a7af18b3f05): created successfully Nov 03 17:25:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eef1d2f-8429-4d43-bc37-cfb1e830c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (1ac891dc-8bf5-46a4-a58e-3e32681b835b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-57ce1e4c-b34d-4d56-957a-85e557049179 tempest-GroupsTest-1757460556 None] Created volume successfully. Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Acquiring lock "cinder-quobyte-c32048bb-6b1e-41de-848c-3a7af18b3f05" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-c32048bb-6b1e-41de-848c-3a7af18b3f05" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd7ea3c-0e40-44d4-9946-fe1887dc81aa]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:53 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 Nov 03 17:25:53 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:53 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05" returned: 0 in 0.535s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:53 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05 Nov 03 17:25:53 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:54 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c32048bb-6b1e-41de-848c-3a7af18b3f05" returned: 0 in 0.336s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-c32048bb-6b1e-41de-848c-3a7af18b3f05" released by "delete_volume" :: held 0.934s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Created reservations ['ffdb93aa-96cc-4569-9904-33b2a15ab6a9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:54 devstack cinder-volume[86995]: WARNING cinder.quota [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-869410461 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-869410461, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:54 devstack cinder-volume[86995]: WARNING cinder.quota [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-869410461 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-869410461, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Created reservations ['b94a3e43-d07c-4260-a675-09e546e146de', '77d370d9-02e2-418b-9f2d-13b4e2ae3971', '1de14987-db88-4cce-8fc3-2e5251909427', '08ec3af8-3215-4400-baac-9fd05627278d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:54 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:54 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Created reservations ['781061de-39d5-49ef-b986-a699b2ab9aed'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:54 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:54 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-224da084-ef3e-47f6-b42f-bb7e9a87ab67 tempest-GroupsTest-1757460556 None] Delete group completed successfully. Nov 03 17:25:55 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:25:55 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:55 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.355s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:55 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:25:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-45d8dc67-b556-4552-9543-4bfdfb4ff988 tempest-GroupsTest-1757460556 None] Delete group completed successfully. Nov 03 17:25:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-95374ae0-0bca-46de-9e5a-c7447cca3070 tempest-GroupsTest-1757460556 None] Group tempest-GroupsTest-Group-1776822569: creating Nov 03 17:25:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-95374ae0-0bca-46de-9e5a-c7447cca3070 tempest-GroupsTest-1757460556 None] Group tempest-GroupsTest-Group-1776822569: created successfully Nov 03 17:25:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-95374ae0-0bca-46de-9e5a-c7447cca3070 tempest-GroupsTest-1757460556 None] Create group completed successfully. Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (e184e07e-ac89-446c-adbe-60a334c89b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3dec6f-03c3-4dec-a423-0838aeef9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3dec6f-03c3-4dec-a423-0838aeef9e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077947933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1eafa4-3c52-435d-b941-36db6a53df53,host='devstack@QuobyteHD#QuobyteHD',id=62970956-23b0-41ee-848b-51a1db3b331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:59Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b58192-077f-4127-a1b9-46e6a673845f),volume_type_id=c8b58192-077f-4127-a1b9-46e6a673845f)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4c46c3-869d-44f4-a23a-cc4b53a88f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4c46c3-869d-44f4-a23a-cc4b53a88f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69d37ea-f080-4223-9a1c-3fe477847b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69d37ea-f080-4223-9a1c-3fe477847b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62970956-23b0-41ee-848b-51a1db3b331c', 'volume_name': 'volume-62970956-23b0-41ee-848b-51a1db3b331c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a415507b-4cf2-4f3d-a234-7b866873a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a415507b-4cf2-4f3d-a234-7b866873a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f60eb56-8014-4b70-b9e1-845177cf5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Volume 62970956-23b0-41ee-848b-51a1db3b331c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62970956-23b0-41ee-848b-51a1db3b331c', 'volume_size': 1} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf1eafa4-3c52-435d-b941-36db6a53df53,created_at=2026-11-03T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077947933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1eafa4-3c52-435d-b941-36db6a53df53,host='devstack@QuobyteHD#QuobyteHD',id=62970956-23b0-41ee-848b-51a1db3b331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:25:59Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b58192-077f-4127-a1b9-46e6a673845f),volume_type_id=c8b58192-077f-4127-a1b9-46e6a673845f)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Creating volume 62970956-23b0-41ee-848b-51a1db3b331c {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:25:58 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:25:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:58 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c 1073741824 Nov 03 17:25:58 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:59 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c 1073741824" returned: 0 in 0.528s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:25:59 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c Nov 03 17:25:59 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:25:59 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c" returned: 0 in 0.288s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f60eb56-8014-4b70-b9e1-845177cf5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62970956-23b0-41ee-848b-51a1db3b331c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcc62cb-7075-4925-a577-a31f8c2ce58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:25:59 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Volume volume-62970956-23b0-41ee-848b-51a1db3b331c (62970956-23b0-41ee-848b-51a1db3b331c): created successfully Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcc62cb-7075-4925-a577-a31f8c2ce58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:25:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (e184e07e-ac89-446c-adbe-60a334c89b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:25:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0e863c40-e64d-49f9-ae33-11ce711888de tempest-GroupsTest-1757460556 None] Created volume successfully. Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (5506529a-b587-4db5-b283-1c5ef42ff3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7913b-78f8-4870-80c7-33c6edaed0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7913b-78f8-4870-80c7-33c6edaed0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-899641427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1eafa4-3c52-435d-b941-36db6a53df53,host='devstack@QuobyteHD#QuobyteHD',id=6d7894a0-2172-4613-b18b-9e055709a3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:01Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b58192-077f-4127-a1b9-46e6a673845f),volume_type_id=c8b58192-077f-4127-a1b9-46e6a673845f)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0384cb-3702-4524-8841-9e5e6e66606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0384cb-3702-4524-8841-9e5e6e66606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33c9395-4ff5-4eb6-8239-8f41bef6b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33c9395-4ff5-4eb6-8239-8f41bef6b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7894a0-2172-4613-b18b-9e055709a3af', 'volume_name': 'volume-6d7894a0-2172-4613-b18b-9e055709a3af', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fda80e-581f-451d-9d82-866af2973811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fda80e-581f-451d-9d82-866af2973811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1181f15b-87ab-48ac-a3b1-f7b9a7937150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:01 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Volume 6d7894a0-2172-4613-b18b-9e055709a3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7894a0-2172-4613-b18b-9e055709a3af', 'volume_size': 1} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf1eafa4-3c52-435d-b941-36db6a53df53,created_at=2026-11-03T16:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-899641427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf1eafa4-3c52-435d-b941-36db6a53df53,host='devstack@QuobyteHD#QuobyteHD',id=6d7894a0-2172-4613-b18b-9e055709a3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32d1fe9d3df412e9028785f7477411c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:01Z,use_quota=True,user_id='b6fff692b6ce48e0a28f5f76496d35ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b58192-077f-4127-a1b9-46e6a673845f),volume_type_id=c8b58192-077f-4127-a1b9-46e6a673845f)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Creating volume 6d7894a0-2172-4613-b18b-9e055709a3af {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:01 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:01 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af 1073741824 Nov 03 17:26:01 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:02 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af 1073741824" returned: 0 in 1.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:02 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af Nov 03 17:26:02 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:03 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1181f15b-87ab-48ac-a3b1-f7b9a7937150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7894a0-2172-4613-b18b-9e055709a3af', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a1d29-b158-4632-9eb5-939989b48cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:03 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Volume volume-6d7894a0-2172-4613-b18b-9e055709a3af (6d7894a0-2172-4613-b18b-9e055709a3af): created successfully Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a1d29-b158-4632-9eb5-939989b48cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Flow 'volume_create_manager' (5506529a-b587-4db5-b283-1c5ef42ff3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cf49654e-2989-4203-a871-efdfe1b9192d tempest-GroupsTest-1757460556 None] Created volume successfully. Nov 03 17:26:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8e64d3e5-3dc4-407a-b476-fd28eacaefd3 tempest-GroupsTest-1757460556 None] Update group completed successfully. Nov 03 17:26:05 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d39a7fc3-0483-48f1-9362-e34f9f0b14ad tempest-GroupsTest-1757460556 None] Update group completed successfully. Nov 03 17:26:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Acquiring lock "cinder-quobyte-62970956-23b0-41ee-848b-51a1db3b331c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-62970956-23b0-41ee-848b-51a1db3b331c" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f552977-e531-4e1c-8503-4b2101ab92af]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:07 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c Nov 03 17:26:07 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:08 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c" returned: 0 in 0.491s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:08 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c Nov 03 17:26:08 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:08 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (d986aa07-6d13-4d30-8ba7-f9ea064c62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad75cc-c6f9-4926-adec-f465c2590f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-62970956-23b0-41ee-848b-51a1db3b331c" returned: 0 in 0.453s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad75cc-c6f9-4926-adec-f465c2590f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646690759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21b189f-79f8-4c05-a9f8-d6c1fe53a528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:09Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d4c488-085d-47c4-91aa-edbf70746e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d4c488-085d-47c4-91aa-edbf70746e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497dcda7-6d0f-4209-ad6e-0904a38643ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497dcda7-6d0f-4209-ad6e-0904a38643ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21b189f-79f8-4c05-a9f8-d6c1fe53a528', 'volume_name': 'volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd597adb-698b-43c0-80dd-30cca4970413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd597adb-698b-43c0-80dd-30cca4970413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38932ca-bc8d-40d9-9644-77713beb2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Volume a21b189f-79f8-4c05-a9f8-d6c1fe53a528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528', 'volume_size': 1} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646690759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21b189f-79f8-4c05-a9f8-d6c1fe53a528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:09Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Creating volume a21b189f-79f8-4c05-a9f8-d6c1fe53a528 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:08 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-62970956-23b0-41ee-848b-51a1db3b331c" released by "delete_volume" :: held 1.062s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Acquiring lock "cinder-quobyte-6d7894a0-2172-4613-b18b-9e055709a3af" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-6d7894a0-2172-4613-b18b-9e055709a3af" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:08 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 1073741824 Nov 03 17:26:08 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[65518be0-4ac5-4f82-9db8-62fa3a121d7d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:09 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af Nov 03 17:26:09 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:09 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 1073741824" returned: 0 in 0.635s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:09 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af" returned: 0 in 0.606s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:09 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af Nov 03 17:26:09 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:09 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 Nov 03 17:26:09 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:09 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d7894a0-2172-4613-b18b-9e055709a3af" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:09 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "cinder-quobyte-6d7894a0-2172-4613-b18b-9e055709a3af" released by "delete_volume" :: held 1.074s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" returned: 0 in 0.410s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38932ca-bc8d-40d9-9644-77713beb2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de928f6e-0dc8-4f82-8c2c-9f408e803f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:10 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Volume volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 (a21b189f-79f8-4c05-a9f8-d6c1fe53a528): created successfully Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de928f6e-0dc8-4f82-8c2c-9f408e803f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (d986aa07-6d13-4d30-8ba7-f9ea064c62e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-17509371-f15b-4cb0-b5ae-e45e47b9dfc4 tempest-VolumesListAdminTestJSON-532514286 None] Created volume successfully. Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Created reservations ['cd3288fe-b92f-47d2-90ae-e39842d4d530'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:10 devstack cinder-volume[86995]: WARNING cinder.quota [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-781920894 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-781920894, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:26:10 devstack cinder-volume[86995]: WARNING cinder.quota [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-781920894 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-781920894, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Created reservations ['48b6da9c-4bd0-46e5-b88f-eeb59335f756', 'baea885d-936d-4044-89b8-d6594f06ff32', '9f09df86-dc33-4484-8dcd-f1b21e248a20', '57737ac9-70d4-4af7-bbde-6e229b4a4bdc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Created reservations ['1c3a6ae4-74cc-46a8-87c2-c0a9c4e67e5d', '712c9364-2b46-413c-ae48-5f235eb52e57', 'e0e8bd46-1593-403a-a4f8-503724e7f423', '2e8bd2c7-30d6-49fa-bdd2-3e087d046660'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:10 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:10 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:11 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e65bc0a6-c9eb-4928-8553-6fac1f421483 tempest-GroupsTest-1757460556 None] Delete group completed successfully. Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (ced07de6-b5f9-43eb-a821-1acb72c875db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b611b6-986f-4ca3-bc7f-3f0a322b58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b611b6-986f-4ca3-bc7f-3f0a322b58d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-493892210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ac31aa-275d-40c6-8ac9-534b56a4f3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:11Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b359d2a0-8817-4c0b-92c5-fc7be5a9b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b359d2a0-8817-4c0b-92c5-fc7be5a9b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc6135f-36d5-4aea-bd4f-2db403c540a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc6135f-36d5-4aea-bd4f-2db403c540a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ac31aa-275d-40c6-8ac9-534b56a4f3f0', 'volume_name': 'volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beeb91fa-e7aa-460b-b0d1-56cf64c11198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beeb91fa-e7aa-460b-b0d1-56cf64c11198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57965c0-af7b-406b-84f2-feefa6c4481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:11 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Volume 97ac31aa-275d-40c6-8ac9-534b56a4f3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0', 'volume_size': 1} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-493892210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ac31aa-275d-40c6-8ac9-534b56a4f3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:11Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Creating volume 97ac31aa-275d-40c6-8ac9-534b56a4f3f0 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:11 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:11 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 1073741824 Nov 03 17:26:11 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:12 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 1073741824" returned: 0 in 0.636s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:12 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 Nov 03 17:26:12 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:12 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57965c0-af7b-406b-84f2-feefa6c4481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb983a72-3d23-42c4-8e13-cf3474900139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:12 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Volume volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 (97ac31aa-275d-40c6-8ac9-534b56a4f3f0): created successfully Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb983a72-3d23-42c4-8e13-cf3474900139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (ced07de6-b5f9-43eb-a821-1acb72c875db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-520ffc0e-f688-457f-b395-44c4431197eb tempest-VolumesListAdminTestJSON-532514286 None] Created volume successfully. Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (0521b289-ddad-4c74-8762-70a76ba64cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d887dcb-bc68-48aa-9ca4-686c1bed83af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d887dcb-bc68-48aa-9ca4-686c1bed83af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1054490866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c30a05-df45-4e1a-98e2-83fc9b4879a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:14Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53904e8a-b3d3-4b57-a474-2dc3a15bcbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53904e8a-b3d3-4b57-a474-2dc3a15bcbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17ade6f-ae2b-4971-8840-d12ee90bd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17ade6f-ae2b-4971-8840-d12ee90bd90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c30a05-df45-4e1a-98e2-83fc9b4879a4', 'volume_name': 'volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa01c0-44c1-47af-a1b3-98e03f419207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa01c0-44c1-47af-a1b3-98e03f419207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766b6581-e3f7-447e-8bea-42cc4a6c26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Volume 39c30a05-df45-4e1a-98e2-83fc9b4879a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4', 'volume_size': 1} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1054490866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c30a05-df45-4e1a-98e2-83fc9b4879a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bee7736a27747f4939b51b61718f9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:14Z,use_quota=True,user_id='2ed6b3e71ecd49d09ecd0679d09f8c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Creating volume 39c30a05-df45-4e1a-98e2-83fc9b4879a4 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:14 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 1073741824 Nov 03 17:26:14 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:15 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 1073741824" returned: 0 in 0.758s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:15 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 Nov 03 17:26:15 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:15 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4" returned: 0 in 0.378s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766b6581-e3f7-447e-8bea-42cc4a6c26b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10567d4-68cc-4325-8a9e-670eb5f4f577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Volume volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 (39c30a05-df45-4e1a-98e2-83fc9b4879a4): created successfully Nov 03 17:26:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10567d4-68cc-4325-8a9e-670eb5f4f577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Flow 'volume_create_manager' (0521b289-ddad-4c74-8762-70a76ba64cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9d8aa967-fad4-4750-bac2-16e11376af41 tempest-VolumesListAdminTestJSON-532514286 None] Created volume successfully. Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Flow 'volume_create_manager' (14d3ecc4-9a97-491b-858d-c2a514bb72c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1466500f-23e1-48e5-a4a4-2b5263078c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1466500f-23e1-48e5-a4a4-2b5263078c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7caeb5a-f753-4652-9908-e475faeaef9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7116c51455f74ab78c277648b60c5029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:17Z,use_quota=True,user_id='12578067ed154deabff0e024ecd960a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5124893-0243-4ea4-a1f9-cb9a24c55085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5124893-0243-4ea4-a1f9-cb9a24c55085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b59619-a63c-4944-83c1-c3c9fbed8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b59619-a63c-4944-83c1-c3c9fbed8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7caeb5a-f753-4652-9908-e475faeaef9b', 'volume_name': 'volume-a7caeb5a-f753-4652-9908-e475faeaef9b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab5a53f-11ba-40be-98b4-9e942e90b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab5a53f-11ba-40be-98b4-9e942e90b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75148630-e564-498e-baad-76a9191e35e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Volume a7caeb5a-f753-4652-9908-e475faeaef9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7caeb5a-f753-4652-9908-e475faeaef9b', 'volume_size': 1} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7caeb5a-f753-4652-9908-e475faeaef9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7116c51455f74ab78c277648b60c5029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:17Z,use_quota=True,user_id='12578067ed154deabff0e024ecd960a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Creating volume a7caeb5a-f753-4652-9908-e475faeaef9b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:17 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b 1073741824 Nov 03 17:26:17 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:18 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b 1073741824" returned: 0 in 0.591s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:18 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b Nov 03 17:26:18 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Flow 'volume_create_manager' (911e5f8f-4b28-4ec1-882f-f051f69da030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850faf9a-dfba-4705-8518-6d8d6b8628b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850faf9a-dfba-4705-8518-6d8d6b8628b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-616459301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd47ca9-1217-409e-9b59-9ee991623203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cc06add96d4fc8b63aa4675312bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:18Z,use_quota=True,user_id='72f49928bd994b6d8cc15e2e8773a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27802f7a-3a0a-4254-ac1b-7966b5f76b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27802f7a-3a0a-4254-ac1b-7966b5f76b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ee4922-7b91-45b4-8fc2-b29ebc40f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ee4922-7b91-45b4-8fc2-b29ebc40f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd47ca9-1217-409e-9b59-9ee991623203', 'volume_name': 'volume-acd47ca9-1217-409e-9b59-9ee991623203', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594748e9-8401-4640-a07f-60b483005567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594748e9-8401-4640-a07f-60b483005567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce16a0b-bf8c-4486-9335-df324f85b18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume acd47ca9-1217-409e-9b59-9ee991623203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd47ca9-1217-409e-9b59-9ee991623203', 'volume_size': 1} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:18 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-616459301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd47ca9-1217-409e-9b59-9ee991623203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cc06add96d4fc8b63aa4675312bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:18Z,use_quota=True,user_id='72f49928bd994b6d8cc15e2e8773a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Creating volume acd47ca9-1217-409e-9b59-9ee991623203 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:18 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:18 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 1073741824 Nov 03 17:26:18 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75148630-e564-498e-baad-76a9191e35e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7caeb5a-f753-4652-9908-e475faeaef9b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5b88ab-d817-49ff-8da8-68debe2f965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Volume volume-a7caeb5a-f753-4652-9908-e475faeaef9b (a7caeb5a-f753-4652-9908-e475faeaef9b): created successfully Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5b88ab-d817-49ff-8da8-68debe2f965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Flow 'volume_create_manager' (14d3ecc4-9a97-491b-858d-c2a514bb72c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-26b6df22-8a0b-4974-ab04-5a871267f527 tempest-VolumesListAdminTestJSON-1732290925 None] Created volume successfully. Nov 03 17:26:19 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 1073741824" returned: 0 in 0.440s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:19 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 Nov 03 17:26:19 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:19 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce16a0b-bf8c-4486-9335-df324f85b18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd47ca9-1217-409e-9b59-9ee991623203', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a9dd90-16de-4e2a-b104-f560a97cbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume volume-acd47ca9-1217-409e-9b59-9ee991623203 (acd47ca9-1217-409e-9b59-9ee991623203): created successfully Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a9dd90-16de-4e2a-b104-f560a97cbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Flow 'volume_create_manager' (911e5f8f-4b28-4ec1-882f-f051f69da030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b9ea5675-016e-4161-aa89-cdfc4be92d96 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Created volume successfully. Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Flow 'volume_create_manager' (4c22399c-f66a-428f-8652-1f8546c13d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c648ea-4978-45cd-a265-1d97932c5d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c648ea-4978-45cd-a265-1d97932c5d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1198094744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdd9afb-3783-4f1f-90e8-ad82324ea4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b5882744384f728df99445fe453bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:19Z,use_quota=True,user_id='58eec0e82f72412186c9e7f37c5df213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c90ba-b9d7-4121-953a-72bbc21decf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c90ba-b9d7-4121-953a-72bbc21decf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465e870d-42ae-4e9a-9a8e-8db53d0ceb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465e870d-42ae-4e9a-9a8e-8db53d0ceb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdd9afb-3783-4f1f-90e8-ad82324ea4c8', 'volume_name': 'volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd821e6-37e5-4451-b48d-bb3d7884e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd821e6-37e5-4451-b48d-bb3d7884e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181967aa-4a8a-42d4-80a4-3c9b65690c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8', 'volume_size': 1} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1198094744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdd9afb-3783-4f1f-90e8-ad82324ea4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b5882744384f728df99445fe453bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:19Z,use_quota=True,user_id='58eec0e82f72412186c9e7f37c5df213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Creating volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:19 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:19 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 1073741824 Nov 03 17:26:19 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Acquiring lock "cinder-a7caeb5a-f753-4652-9908-e475faeaef9b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "cinder-a7caeb5a-f753-4652-9908-e475faeaef9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Acquiring lock "cinder-quobyte-a7caeb5a-f753-4652-9908-e475faeaef9b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "cinder-quobyte-a7caeb5a-f753-4652-9908-e475faeaef9b" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e810402-cf67-49b0-9b4c-aca2ed8ff5ac]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-39c30a05-df45-4e1a-98e2-83fc9b4879a4-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-39c30a05-df45-4e1a-98e2-83fc9b4879a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-quobyte-39c30a05-df45-4e1a-98e2-83fc9b4879a4" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:19 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b Nov 03 17:26:19 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-39c30a05-df45-4e1a-98e2-83fc9b4879a4" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[34565e75-7b2a-4a2e-8178-ccd3b7d82890]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 Nov 03 17:26:20 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 1073741824" returned: 0 in 0.473s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 Nov 03 17:26:20 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b Nov 03 17:26:20 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4" returned: 0 in 0.498s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:20 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4 Nov 03 17:26:20 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "cinder-acd47ca9-1217-409e-9b59-9ee991623203-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181967aa-4a8a-42d4-80a4-3c9b65690c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda8fccf-39a3-4937-acac-8d4a24a43c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "cinder-acd47ca9-1217-409e-9b59-9ee991623203-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Volume volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 (2bdd9afb-3783-4f1f-90e8-ad82324ea4c8): created successfully Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda8fccf-39a3-4937-acac-8d4a24a43c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:20 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Flow 'volume_create_manager' (4c22399c-f66a-428f-8652-1f8546c13d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a7caeb5a-f753-4652-9908-e475faeaef9b" returned: 0 in 0.353s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "cinder-quobyte-a7caeb5a-f753-4652-9908-e475faeaef9b" released by "delete_volume" :: held 0.847s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1a3c2eba-2a1c-44b1-b15c-dde43c6d70aa tempest-SnapshotsActionsTest-1640310559 None] Created volume successfully. Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "cinder-quobyte-acd47ca9-1217-409e-9b59-9ee991623203" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "cinder-quobyte-acd47ca9-1217-409e-9b59-9ee991623203" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a8cea-055a-4784-b29a-ec46831e8156]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Created reservations ['fe853cb3-e9cd-41ab-abc8-6498767f8223', 'f02fa104-04ae-4606-819b-d85ac5f3c2fc', 'f14a04e9-7c36-4180-b60c-5f02b03bea44', '2d05d929-5bbc-4d21-99d2-4b820018f920'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-39c30a05-df45-4e1a-98e2-83fc9b4879a4" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:20 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 Nov 03 17:26:20 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:20 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-39c30a05-df45-4e1a-98e2-83fc9b4879a4" released by "delete_volume" :: held 0.856s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Created reservations ['61283185-331f-4e52-84fc-1059f2c3f0c0', '613937f0-705d-473e-870a-db475fa12502', 'c78cff58-0559-4501-9dbe-2651bf21b5e0', '16ebccf7-250c-498c-9c05-3a1bceae4082'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:20 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:20 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:21 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Deleted volume successfully. Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9906c078-1abf-4308-ab9e-0e9770413c6b tempest-VolumesListAdminTestJSON-1732290925 None] Lock "cinder-a7caeb5a-f753-4652-9908-e475faeaef9b-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:21 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-97ac31aa-275d-40c6-8ac9-534b56a4f3f0-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:21 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203 Nov 03 17:26:21 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-97ac31aa-275d-40c6-8ac9-534b56a4f3f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-quobyte-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:21 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.320s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Deleted volume successfully. Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5565b116-6203-41a3-9310-8a4fe58271f0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8ed23fa3-41a0-4833-bbec-e8246b1513c6 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-39c30a05-df45-4e1a-98e2-83fc9b4879a4-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:21 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 Nov 03 17:26:21 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:21 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-acd47ca9-1217-409e-9b59-9ee991623203" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "cinder-quobyte-acd47ca9-1217-409e-9b59-9ee991623203" released by "delete_volume" :: held 0.746s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Created reservations ['e53718ea-6d6c-4186-9264-5945f5d981d5', 'e031bedd-baac-427f-83a3-8608f32f11e8', '20855538-2a8a-4c35-9d7c-a63fa3a4d558', '03e9e745-3124-46f1-a879-7d7cdcee515c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:21 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:21 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:21 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:21 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0 Nov 03 17:26:21 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:21 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.404s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Deleted volume successfully. Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5c1d6142-8563-4b36-a695-32999f92aab7 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "cinder-acd47ca9-1217-409e-9b59-9ee991623203-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Creating offline snapshot 8ae325ec-3e99-4e49-92e7-e0e0dcd33056 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ed735-d5b3-4eac-8da7-11266e6aa1e8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:22 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" returned: 0 in 0.372s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-97ac31aa-275d-40c6-8ac9-534b56a4f3f0" released by "delete_volume" :: held 0.878s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Created reservations ['4644682b-9753-4ff4-84c1-79e6a143e520', '7b3c0007-2010-4f0b-bb48-6f75669198c7', 'fc9866b3-4883-4a52-8a75-40fc0da0db04', '5ab876d8-79df-4863-a089-ac12063ad327'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:22 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 Nov 03 17:26:22 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:22 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:22 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-a21b189f-79f8-4c05-a9f8-d6c1fe53a528-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-a21b189f-79f8-4c05-a9f8-d6c1fe53a528-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Flow 'volume_create_manager' (74b768da-3467-4344-afd9-61c6ddce3f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6100309d-56ae-4b1d-8aeb-6205fd55b4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6100309d-56ae-4b1d-8aeb-6205fd55b4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-561467186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4545a555-2ca1-4382-9a25-3441d660e352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cc06add96d4fc8b63aa4675312bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:22Z,use_quota=True,user_id='72f49928bd994b6d8cc15e2e8773a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4962279b-9bfa-4d86-9c54-41a28af0b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4962279b-9bfa-4d86-9c54-41a28af0b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9f7379-7399-4fbd-9f8e-5e027287a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:22 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9f7379-7399-4fbd-9f8e-5e027287a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4545a555-2ca1-4382-9a25-3441d660e352', 'volume_name': 'volume-4545a555-2ca1-4382-9a25-3441d660e352', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cabf51-3327-44ff-9899-3ebf99309750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cabf51-3327-44ff-9899-3ebf99309750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:22 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb44315-8e33-4931-99a4-3f64f8836a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:22 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume 4545a555-2ca1-4382-9a25-3441d660e352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4545a555-2ca1-4382-9a25-3441d660e352', 'volume_size': 1} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "cinder-quobyte-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" returned: 0 in 0.647s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Deleted volume successfully. Nov 03 17:26:22 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 1G Nov 03 17:26:22 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0392fa0-6e66-4c2c-95be-c88192aa439c tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-97ac31aa-275d-40c6-8ac9-534b56a4f3f0-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3fb5ff-831b-4008-8b6a-786fb570d963]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:22 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 Nov 03 17:26:22 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:23 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 1G" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:23 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:23 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:23 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" returned: 0 in 0.412s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:23 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528 Nov 03 17:26:23 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:23 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 is being set with open permissions: ugo+rw Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:23 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" returned: 0 in 0.280s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-quobyte-a21b189f-79f8-4c05-a9f8-d6c1fe53a528" released by "delete_volume" :: held 0.747s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:23 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Created reservations ['80b4df29-2285-4e98-a0d6-6e156630fddc', '2672ff0a-4dcf-4650-b3ec-8f2aeb93f64b', '131515d0-37ca-4892-a2ea-275a77a3c82f', '9c2f5a18-51de-43b1-9996-fd1301116e76'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:23 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:23 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:23 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Deleted volume successfully. Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-999de67b-145a-4ea8-863d-95056298c8a3 tempest-VolumesListAdminTestJSON-532514286 None] Lock "cinder-a21b189f-79f8-4c05-a9f8-d6c1fe53a528-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:23 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info Nov 03 17:26:23 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:24 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info" returned: 0 in 0.292s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:24 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info is being set with open permissions: ugo+rw Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:24 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info Nov 03 17:26:24 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:24 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.info" returned: 0 in 0.255s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-561467186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4545a555-2ca1-4382-9a25-3441d660e352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cc06add96d4fc8b63aa4675312bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:22Z,use_quota=True,user_id='72f49928bd994b6d8cc15e2e8773a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Creating volume 4545a555-2ca1-4382-9a25-3441d660e352 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:24 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:24 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 1073741824 Nov 03 17:26:24 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:24 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-adeb1e29-154f-4dc2-97f8-da6e5865d24a tempest-SnapshotsActionsTest-1640310559 None] Create snapshot completed successfully Nov 03 17:26:24 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 1073741824" returned: 0 in 0.458s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:24 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 Nov 03 17:26:24 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:25 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352" returned: 0 in 0.311s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb44315-8e33-4931-99a4-3f64f8836a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4545a555-2ca1-4382-9a25-3441d660e352', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699a87f3-c493-4147-9458-7ae98c7f74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:25 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Volume volume-4545a555-2ca1-4382-9a25-3441d660e352 (4545a555-2ca1-4382-9a25-3441d660e352): created successfully Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699a87f3-c493-4147-9458-7ae98c7f74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Flow 'volume_create_manager' (74b768da-3467-4344-afd9-61c6ddce3f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:25 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2e9f9266-d589-437e-a172-e4b5cd591127 tempest-VolumeQuotasAdminTestJSON-1722775907 None] Created volume successfully. Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (f784fa8a-2e9e-4e7c-891b-4c7a05528722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3db4dd-fa11-4faa-a4ee-76bac5e2900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3db4dd-fa11-4faa-a4ee-76bac5e2900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554198938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c6bd5-ede1-4bf9-897b-ff666923d477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:26Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef10d8-75f2-4824-a2cb-e2bf1df361f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef10d8-75f2-4824-a2cb-e2bf1df361f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76826e7e-5bb1-44b3-9202-d99077d7a854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76826e7e-5bb1-44b3-9202-d99077d7a854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92c6bd5-ede1-4bf9-897b-ff666923d477', 'volume_name': 'volume-b92c6bd5-ede1-4bf9-897b-ff666923d477', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577ce5c1-86e5-4da5-a39e-c54d75569e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577ce5c1-86e5-4da5-a39e-c54d75569e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b349d6-bf72-4a52-9302-fc9c77eb2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:26 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Volume b92c6bd5-ede1-4bf9-897b-ff666923d477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92c6bd5-ede1-4bf9-897b-ff666923d477', 'volume_size': 1} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554198938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c6bd5-ede1-4bf9-897b-ff666923d477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:26Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Creating volume b92c6bd5-ede1-4bf9-897b-ff666923d477 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:26 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:26 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 1073741824 Nov 03 17:26:26 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f7ffe82f-e2e9-4f50-b408-93dc836e72f9 tempest-VolumeQuotasAdminTestJSON-726783359 None] Transfer volume completed successfully. Nov 03 17:26:26 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 1073741824" returned: 0 in 0.564s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:27 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 Nov 03 17:26:27 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Acquiring lock "cinder-4545a555-2ca1-4382-9a25-3441d660e352-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "cinder-4545a555-2ca1-4382-9a25-3441d660e352-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Acquiring lock "cinder-quobyte-4545a555-2ca1-4382-9a25-3441d660e352" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "cinder-quobyte-4545a555-2ca1-4382-9a25-3441d660e352" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[217fd4f5-3593-465c-b546-dee040391c74]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:27 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:27 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 Nov 03 17:26:27 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.900s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b349d6-bf72-4a52-9302-fc9c77eb2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92c6bd5-ede1-4bf9-897b-ff666923d477', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873db90f-0d3e-4257-bcec-22ce7f7d2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Creating offline snapshot 778e561c-371d-4b95-a5a6-63f65db90cd4 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:27 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Volume volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 (b92c6bd5-ede1-4bf9-897b-ff666923d477): created successfully Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873db90f-0d3e-4257-bcec-22ce7f7d2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (f784fa8a-2e9e-4e7c-891b-4c7a05528722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2cd20c-218d-40c9-b963-f6205eb054bb]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9ba04e97-0600-40fd-8207-d1a1685b5082 tempest-AttachVolumeNegativeTest-1927615303 None] Created volume successfully. Nov 03 17:26:27 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:27 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:27 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352" returned: 0 in 0.421s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:27 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352 Nov 03 17:26:27 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:27 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.384s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:27 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 1G Nov 03 17:26:27 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:27 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4545a555-2ca1-4382-9a25-3441d660e352" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "cinder-quobyte-4545a555-2ca1-4382-9a25-3441d660e352" released by "delete_volume" :: held 0.738s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Created reservations ['4ebdac84-cb66-4c62-9ad4-1ee6e7319966', '4fdb6cec-da1d-48af-976c-4e712ef92ee9', '1322fccb-3f96-4a31-b5a6-8ea2b9ea7d23', '1ac50c48-b5c0-46f2-993a-79ed77dd7c5f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:28 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:28 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:28 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Deleted volume successfully. Nov 03 17:26:28 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 1G" returned: 0 in 0.519s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7c3ff5a7-4bec-4dbc-9cff-54d10ac89379 tempest-VolumeQuotasAdminTestJSON-1263605916 None] Lock "cinder-4545a555-2ca1-4382-9a25-3441d660e352-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:28 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 Nov 03 17:26:28 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:28 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4" returned: 0 in 0.418s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:28 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 is being set with open permissions: ugo+rw Nov 03 17:26:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:28 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 Nov 03 17:26:28 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:29 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4" returned: 0 in 0.316s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:29 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b97bf4ce-2d25-4a28-bf8c-be6963895cb9 tempest-SnapshotsActionsTest-1640310559 None] Create snapshot completed successfully Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a7d7af0b-f42e-47f4-bd57-eeef492c2e50 req-73c249d3-9588-4e79-90b3-0d322fbce4e5 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a7d7af0b-f42e-47f4-bd57-eeef492c2e50 req-73c249d3-9588-4e79-90b3-0d322fbce4e5 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-a7d7af0b-f42e-47f4-bd57-eeef492c2e50 req-73c249d3-9588-4e79-90b3-0d322fbce4e5 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-a7d7af0b-f42e-47f4-bd57-eeef492c2e50 req-73c249d3-9588-4e79-90b3-0d322fbce4e5 tempest-AttachVolumeNegativeTest-1927615303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-b92c6bd5-ede1-4bf9-897b-ff666923d477', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d2de7d1-b8a4-4cdc-acf3-f8b928d110d4', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:26:29 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-a7d7af0b-f42e-47f4-bd57-eeef492c2e50 req-73c249d3-9588-4e79-90b3-0d322fbce4e5 tempest-AttachVolumeNegativeTest-1927615303 None] attachment_update completed successfully. Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-778e561c-371d-4b95-a5a6-63f65db90cd4-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-778e561c-371d-4b95-a5a6-63f65db90cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-778e561c-371d-4b95-a5a6-63f65db90cd4" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Flow 'volume_create_manager' (1b16ee5d-3d0a-44cb-9921-e6f7f4460306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3468884-d0ca-491f-8309-fbe9993d7aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-778e561c-371d-4b95-a5a6-63f65db90cd4" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Deleting offline snapshot 778e561c-371d-4b95-a5a6-63f65db90cd4 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] snapshot_file for this snap is: volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3468884-d0ca-491f-8309-fbe9993d7aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1341514588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ddf05-b1c2-435b-ae2d-8a1f9f571839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ea9bcd460f48768638d8e34e57cbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:30Z,use_quota=True,user_id='d0e102ed58da4cbbad695a4540d159ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3c440a-ce93-4720-b5d3-ef8346ddba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3c440a-ce93-4720-b5d3-ef8346ddba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25dd05-8ae4-4169-ac36-64a585b9f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25dd05-8ae4-4169-ac36-64a585b9f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3ddf05-b1c2-435b-ae2d-8a1f9f571839', 'volume_name': 'volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663db937-fb38-406d-ad1a-68f836ff2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663db937-fb38-406d-ad1a-68f836ff2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48fc969-c4bd-4a34-9fab-bce0c34c9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Volume db3ddf05-b1c2-435b-ae2d-8a1f9f571839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839', 'volume_size': 1} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1341514588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ddf05-b1c2-435b-ae2d-8a1f9f571839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ea9bcd460f48768638d8e34e57cbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:30Z,use_quota=True,user_id='d0e102ed58da4cbbad695a4540d159ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Creating volume db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:30 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[089371bc-e67b-48b0-9e51-98ced01ce6ee]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:30 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 1073741824 Nov 03 17:26:30 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:30 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 Nov 03 17:26:30 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:30 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4" returned: 0 in 0.463s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bebf4f0-9be1-4459-8d5c-74cab695c06a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:30 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 1073741824" returned: 0 in 0.634s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:30 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:30 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:30 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 Nov 03 17:26:30 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:31 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.481s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:31 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:31 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" returned: 0 in 0.326s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:31 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48fc969-c4bd-4a34-9fab-bce0c34c9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8a44f6-115e-4feb-a8b7-0b2681ebbd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Volume volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 (db3ddf05-b1c2-435b-ae2d-8a1f9f571839): created successfully Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8a44f6-115e-4feb-a8b7-0b2681ebbd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Flow 'volume_create_manager' (1b16ee5d-3d0a-44cb-9921-e6f7f4460306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-85e35990-8ba2-4732-ae87-6e1090196338 tempest-SnapshotMetadataTestJSON-900352142 None] Created volume successfully. Nov 03 17:26:31 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:31 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4 Nov 03 17:26:31 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:31 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.778e561c-371d-4b95-a5a6-63f65db90cd4" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-778e561c-371d-4b95-a5a6-63f65db90cd4" released by "_delete_snapshot" :: held 1.863s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_snapshot" :: held 1.956s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:31 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Created reservations ['ed26651c-69ea-4cda-8bfb-33ba9595256e', 'd3f1b745-d528-4d57-8231-011a3ccf3c51', 'edae8490-c4b2-41d6-8867-aebb65a8da27', '513d9767-3276-4cdc-8d3d-1964ea090e80'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Delete snapshot completed successfully. Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-417c8559-5588-4766-9813-e70f7e7f2f4e tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-778e561c-371d-4b95-a5a6-63f65db90cd4-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Creating offline snapshot b947fc9a-5f36-47eb-86be-22af0e7f8c8e of volume db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e4a6de-8cb8-4290-b101-536e465e6aec]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:32 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 Nov 03 17:26:32 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:32 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" returned: 0 in 0.443s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:32 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e 1G Nov 03 17:26:32 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:33 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e 1G" returned: 0 in 0.531s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:33 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e Nov 03 17:26:33 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:33 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e" returned: 0 in 0.330s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:33 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e is being set with open permissions: ugo+rw Nov 03 17:26:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:33 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e Nov 03 17:26:33 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:34 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:34 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info Nov 03 17:26:34 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:34 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info" returned: 0 in 0.260s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:34 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info is being set with open permissions: ugo+rw Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:34 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info Nov 03 17:26:34 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:34 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.info" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.157s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Creating offline snapshot 3d77361f-d9d6-40fa-a9dc-12ac40ad2562 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4966104-d299-473d-b64f-06b1969585b5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c5468300-ad65-4036-ba30-c7f4f1392bb6 tempest-SnapshotMetadataTestJSON-900352142 None] Create snapshot completed successfully Nov 03 17:26:34 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:34 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:35 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:35 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 1G Nov 03 17:26:35 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:35 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 1G" returned: 0 in 0.657s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:35 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 Nov 03 17:26:35 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:36 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562" returned: 0 in 0.378s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:36 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 is being set with open permissions: ugo+rw Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:36 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 Nov 03 17:26:36 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:36 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562" returned: 0 in 0.419s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=180,cinder:SELECT=149,cinder:DELETE=10,cinder:INSERT=36 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=176,cinder:SELECT=138,cinder:INSERT=41,cinder:DELETE=15 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bd350ab0-7a70-4797-9389-67f998411d60 tempest-SnapshotsActionsTest-1640310559 None] Create snapshot completed successfully Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "cinder-b947fc9a-5f36-47eb-86be-22af0e7f8c8e-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-b947fc9a-5f36-47eb-86be-22af0e7f8c8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "cinder-quobyte-b947fc9a-5f36-47eb-86be-22af0e7f8c8e" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-b947fc9a-5f36-47eb-86be-22af0e7f8c8e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Deleting offline snapshot b947fc9a-5f36-47eb-86be-22af0e7f8c8e of volume db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] snapshot_file for this snap is: volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f30ea5-ab1a-4e88-8f82-c6f0c8274191]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:37 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e Nov 03 17:26:37 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:37 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e" returned: 0 in 0.572s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a2357-6400-4a13-ad68-9589e24f4d20]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Flow 'volume_create_manager' (e5962bdb-13e5-4f6a-a14e-7af91e18f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b88a59-f7c3-46d4-9e73-59694cab27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b88a59-f7c3-46d4-9e73-59694cab27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843604724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b4aed9-5f9b-4902-9c15-3503c5d50305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c006f15fa7374af79179dd2543ce8c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:37Z,use_quota=True,user_id='3de590f8da1247aba16c0e0bdb7daf50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d611addc-cfa8-449f-a2d1-76e8061c94df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d611addc-cfa8-449f-a2d1-76e8061c94df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9be591-2e35-4953-891f-b67489c730ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:37 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:26:37 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 Nov 03 17:26:37 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-3d77361f-d9d6-40fa-a9dc-12ac40ad2562-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:38 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" returned: 0 in 0.546s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-3d77361f-d9d6-40fa-a9dc-12ac40ad2562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:38 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e Nov 03 17:26:38 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9be591-2e35-4953-891f-b67489c730ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84b4aed9-5f9b-4902-9c15-3503c5d50305', 'volume_name': 'volume-84b4aed9-5f9b-4902-9c15-3503c5d50305', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab9821b-020d-4e62-a3aa-b3af150ccce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab9821b-020d-4e62-a3aa-b3af150ccce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6704685-84e5-46e2-afab-d97850c110eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:38 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Volume 84b4aed9-5f9b-4902-9c15-3503c5d50305: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84b4aed9-5f9b-4902-9c15-3503c5d50305', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Trying to clone 84b4aed9-5f9b-4902-9c15-3503c5d50305 from image 0146c52b-9712-4e77-91c3-cd4953180efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_snapshot" :: waited 0.076s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-3d77361f-d9d6-40fa-a9dc-12ac40ad2562" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-3d77361f-d9d6-40fa-a9dc-12ac40ad2562" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Deleting offline snapshot 3d77361f-d9d6-40fa-a9dc-12ac40ad2562 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] snapshot_file for this snap is: volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a83fe6-746b-4ca0-9601-8f655b7cd769]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 Nov 03 17:26:38 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:38 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e" returned: 0 in 0.516s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e Nov 03 17:26:38 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:26:38 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:26:38 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562" returned: 0 in 0.490s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f9464-9be4-4138-9029-fbe04e1b0bc0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffc1df-11d0-4ef7-a273-a67ec63e98cc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:38 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:38 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:38 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:38 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:39 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD Nov 03 17:26:39 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:39 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839.b947fc9a-5f36-47eb-86be-22af0e7f8c8e" returned: 0 in 0.391s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-b947fc9a-5f36-47eb-86be-22af0e7f8c8e" released by "_delete_snapshot" :: held 2.215s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" released by "delete_snapshot" :: held 2.258s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Created reservations ['a76e4ccb-9933-442b-aaae-56c2b262362d', 'ecc83174-63f8-4596-aceb-2908e5eb4227', '82a6b616-4bee-4fdb-9eaf-20e51ca91f50', '387c62e2-9423-4d32-b523-0b721a6874db'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:39 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.501s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:39 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.467s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:26:39 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 Nov 03 17:26:39 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Delete snapshot completed successfully. Nov 03 17:26:39 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe is fetched for user 3de590f8da1247aba16c0e0bdb7daf50. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-67f46632-b3d7-40c7-992a-e0ca9df224c8 tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-b947fc9a-5f36-47eb-86be-22af0e7f8c8e-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9fda26-6827-4b01-94f3-171ef5d72a43]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:39 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD Nov 03 17:26:39 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:39 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562" returned: 0 in 0.493s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:39 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562 Nov 03 17:26:39 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:39 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843604724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b4aed9-5f9b-4902-9c15-3503c5d50305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c006f15fa7374af79179dd2543ce8c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:37Z,use_quota=True,user_id='3de590f8da1247aba16c0e0bdb7daf50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Creating volume 84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:39 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:39 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1073741824 Nov 03 17:26:39 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:40 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.3d77361f-d9d6-40fa-a9dc-12ac40ad2562" returned: 0 in 0.343s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "cinder-db3ddf05-b1c2-435b-ae2d-8a1f9f571839-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-3d77361f-d9d6-40fa-a9dc-12ac40ad2562" released by "_delete_snapshot" :: held 2.040s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_snapshot" :: held 2.121s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-db3ddf05-b1c2-435b-ae2d-8a1f9f571839-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c6db15-9c3a-40f3-b70d-cc2a5f47030b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Created reservations ['5f1a45f9-ffe4-4084-8dda-141ac30c9768', '0223f99e-b89d-42ff-9428-3c9a43be61a7', '5ff6f04c-c008-46cc-affa-bf212c40707b', '342678e4-70ea-4875-9729-b26ff701eccf'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Delete snapshot completed successfully. Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9d471c98-0d34-4264-a469-cf79d935ba8a tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-3d77361f-d9d6-40fa-a9dc-12ac40ad2562-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:40 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1073741824" returned: 0 in 0.835s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:40 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 Nov 03 17:26:40 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:40 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 Nov 03 17:26:40 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:41 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" returned: 0 in 0.686s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:41 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839 Nov 03 17:26:41 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:41 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305" returned: 0 in 0.511s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Attempting download of 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 84b4aed9-5f9b-4902-9c15-3503c5d50305. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[389af92e-7bb1-4231-a318-b93f710a9f3d]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:41 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef Nov 03 17:26:41 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:41 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" returned: 0 in 0.521s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-quobyte-db3ddf05-b1c2-435b-ae2d-8a1f9f571839" released by "delete_volume" :: held 1.317s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:41 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Created reservations ['3c3575b5-9894-4d80-a3ef-119666a75abb', '503b3e68-0dff-4e5b-a8ed-90f20c186352', '79b2c6e6-be93-4d72-b5cc-4f03881ae178', 'ef4906f4-f60b-4b5a-ba00-72034a38b661'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:42 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef" returned: 0 in 0.560s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:42 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:42 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Creating offline snapshot cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:42 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef Nov 03 17:26:42 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1d98f-bf1c-4d39-94f0-59797a08042d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:42 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:42 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:42 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef" returned: 1 in 0.668s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_dcx0p3ef' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3401fa-8f1e-4ba1-a859-59992ea103ad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:42 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.787s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:42 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Deleted volume successfully. Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b5714e06-39f7-44e2-9c63-00e49ec0029e tempest-SnapshotMetadataTestJSON-900352142 None] Lock "cinder-db3ddf05-b1c2-435b-ae2d-8a1f9f571839-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:43 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD Nov 03 17:26:43 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:43 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.985s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:43 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 1G Nov 03 17:26:43 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:43 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD" returned: 0 in 0.655s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] 0146c52b-9712-4e77-91c3-cd4953180efe was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:26:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:43 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 Nov 03 17:26:43 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:44 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 1G" returned: 0 in 0.704s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:44 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 Nov 03 17:26:44 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:44 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" returned: 0 in 0.499s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:44 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 is being set with open permissions: ugo+rw Nov 03 17:26:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:44 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 Nov 03 17:26:44 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:45 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" returned: 0 in 0.435s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2d8d6dde-5deb-4497-b017-547c17639604 tempest-SnapshotsActionsTest-1640310559 None] Create snapshot completed successfully Nov 03 17:26:46 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305" returned: 0 in 2.597s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe__7glgzwldevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:26:46 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Converted 112.00 MB image at 43.11 MB/s Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:46 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1G Nov 03 17:26:46 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:46 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 1G" returned: 0 in 0.657s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Downloaded image 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 84b4aed9-5f9b-4902-9c15-3503c5d50305 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe for user 3de590f8da1247aba16c0e0bdb7daf50 is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Marking volume 84b4aed9-5f9b-4902-9c15-3503c5d50305 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Deleting offline snapshot cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] snapshot_file for this snap is: volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f77af3-ebd8-4425-aad3-610c2579e05b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Copying metadata from image 0146c52b-9712-4e77-91c3-cd4953180efe to 84b4aed9-5f9b-4902-9c15-3503c5d50305. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:26:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Creating volume glance metadata for volume 84b4aed9-5f9b-4902-9c15-3503c5d50305 backed by image 0146c52b-9712-4e77-91c3-cd4953180efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:26:46 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 Nov 03 17:26:46 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6704685-84e5-46e2-afab-d97850c110eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b4aed9-5f9b-4902-9c15-3503c5d50305', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4619c8d8-65c8-4e1f-b3a9-08498af69569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Volume volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 (84b4aed9-5f9b-4902-9c15-3503c5d50305): created successfully Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4619c8d8-65c8-4e1f-b3a9-08498af69569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Flow 'volume_create_manager' (e5962bdb-13e5-4f6a-a14e-7af91e18f87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2145b49d-0b2e-463a-aa4e-5989eef6d90b tempest-VolumesImageMetadata-1032028200 None] Created volume successfully. Nov 03 17:26:47 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" returned: 0 in 0.535s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad76bf8-d2c8-4b2b-96d7-f1a439122dcd]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:47 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:47 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:48 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.672s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:48 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 Nov 03 17:26:48 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:48 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" returned: 0 in 0.507s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Acquiring lock "cinder-84b4aed9-5f9b-4902-9c15-3503c5d50305-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:48 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8 Nov 03 17:26:48 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "cinder-84b4aed9-5f9b-4902-9c15-3503c5d50305-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Acquiring lock "cinder-quobyte-84b4aed9-5f9b-4902-9c15-3503c5d50305" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "cinder-quobyte-84b4aed9-5f9b-4902-9c15-3503c5d50305" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[45882bb9-7da0-4642-a59a-35b7fd7ef41a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:48 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 Nov 03 17:26:48 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:49 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" returned: 0 in 0.439s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8" released by "_delete_snapshot" :: held 2.299s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_snapshot" :: held 2.362s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Created reservations ['eb39f570-58de-46ee-97dd-1bc8e12b4e21', '9fff9e04-98d2-4362-a62d-d565eefb410e', '3da8280b-78a5-40a7-9676-bae5d038e61c', 'efd0a9d1-c6d6-4092-a3fa-85fbb2391f5a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Delete snapshot completed successfully. Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bea5c704-12b0-40b0-93bd-a502d910baa3 tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-cf853bf8-aa68-43d9-a1bf-8318b1f89ce8-delete_snapshot" released by "delete_snapshot" :: held 2.595s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:49 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305" returned: 0 in 0.476s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:49 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305 Nov 03 17:26:49 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:49 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-84b4aed9-5f9b-4902-9c15-3503c5d50305" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "cinder-quobyte-84b4aed9-5f9b-4902-9c15-3503c5d50305" released by "delete_volume" :: held 0.854s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Created reservations ['5f5d6f0b-f2d1-479f-a384-c62e84118459', '683e0aac-207d-4e8c-9b33-8cfa3188faf1', 'be64a5db-0821-4fb9-b1ef-77c5be6a1e7b', 'fc4bbdb6-ea1e-4ced-8c10-646adb52721d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:49 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:49 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:50 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Deleted volume successfully. Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f23dbaad-6169-439e-b271-313d81173a5b tempest-VolumesImageMetadata-1032028200 None] Lock "cinder-84b4aed9-5f9b-4902-9c15-3503c5d50305-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Creating offline snapshot 798771ec-008a-4b45-ae7e-1c8c51bc2f16 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f3d4a-f883-4df9-85a5-110b1264fade]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:50 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:50 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:51 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.497s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:51 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 1G Nov 03 17:26:51 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:51 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 1G" returned: 0 in 0.684s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:51 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 Nov 03 17:26:51 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:52 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16" returned: 0 in 0.497s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:52 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 is being set with open permissions: ugo+rw Nov 03 17:26:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:52 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 Nov 03 17:26:52 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:52 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-dc2df4c6-9bec-45cc-8aba-4528cc230396 tempest-SnapshotsActionsTest-1640310559 None] Create snapshot completed successfully Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-798771ec-008a-4b45-ae7e-1c8c51bc2f16-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-798771ec-008a-4b45-ae7e-1c8c51bc2f16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Acquiring lock "cinder-quobyte-798771ec-008a-4b45-ae7e-1c8c51bc2f16" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-798771ec-008a-4b45-ae7e-1c8c51bc2f16" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Deleting offline snapshot 798771ec-008a-4b45-ae7e-1c8c51bc2f16 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] snapshot_file for this snap is: volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae698b98-9794-4133-b70d-73dfd3c90238]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:54 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 Nov 03 17:26:54 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:54 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16" returned: 0 in 0.622s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Flow 'volume_create_manager' (c45fd8bc-efeb-4fa0-adf4-eb093e157af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0649c5c-7e50-4b43-ad9d-01d5a0b2b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b24d6d4-cb39-423d-8067-78ace0537f1a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0649c5c-7e50-4b43-ad9d-01d5a0b2b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-770689119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc50a65f-3650-4736-9bfe-18adc477f8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5651f38185874413a5ff4136ce0499a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:54Z,use_quota=True,user_id='85623b8dbb6a4e989ddb547e90834900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfbb1e4-0254-4e99-9113-752f4bf36432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfbb1e4-0254-4e99-9113-752f4bf36432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcd1af0-1fb7-4993-8779-245f53b8ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcd1af0-1fb7-4993-8779-245f53b8ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc50a65f-3650-4736-9bfe-18adc477f8c2', 'volume_name': 'volume-cc50a65f-3650-4736-9bfe-18adc477f8c2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a01f00-f6a1-4bc8-af3c-a375d3741aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a01f00-f6a1-4bc8-af3c-a375d3741aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94521354-ce47-46c5-bb62-5c20fe8d73a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:54 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Volume cc50a65f-3650-4736-9bfe-18adc477f8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc50a65f-3650-4736-9bfe-18adc477f8c2', 'volume_size': 1} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-770689119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc50a65f-3650-4736-9bfe-18adc477f8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5651f38185874413a5ff4136ce0499a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:54Z,use_quota=True,user_id='85623b8dbb6a4e989ddb547e90834900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Creating volume cc50a65f-3650-4736-9bfe-18adc477f8c2 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:54 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:54 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 1073741824 Nov 03 17:26:54 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:54 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:54 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:55 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.505s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:55 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 Nov 03 17:26:55 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Flow 'volume_create_manager' (fc1b9262-f4ee-46c5-b63c-d0ab93d1e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9c63c-12b1-4f45-9e78-65d11420de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca9c63c-12b1-4f45-9e78-65d11420de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366032337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512e646d-763f-46ce-bd94-f95a13df176b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379ce463c1a54a15852eb41bac609caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:55Z,use_quota=True,user_id='998e87f92eff429aa62017346dc2795a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b78d1-7c53-4a31-b0cc-2ae3d26fb70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b78d1-7c53-4a31-b0cc-2ae3d26fb70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d87e64-e422-42a0-80ea-a667a9365a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d87e64-e422-42a0-80ea-a667a9365a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512e646d-763f-46ce-bd94-f95a13df176b', 'volume_name': 'volume-512e646d-763f-46ce-bd94-f95a13df176b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d1e11e-97cb-4a99-905b-edc1ac669908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d1e11e-97cb-4a99-905b-edc1ac669908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fe97c1-7962-4fe4-848a-2090f435d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Volume 512e646d-763f-46ce-bd94-f95a13df176b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512e646d-763f-46ce-bd94-f95a13df176b', 'volume_size': 1} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:55 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 1073741824" returned: 0 in 0.613s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:55 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 Nov 03 17:26:55 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:55 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:55 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16 Nov 03 17:26:55 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:55 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366032337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512e646d-763f-46ce-bd94-f95a13df176b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379ce463c1a54a15852eb41bac609caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:26:55Z,use_quota=True,user_id='998e87f92eff429aa62017346dc2795a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Creating volume 512e646d-763f-46ce-bd94-f95a13df176b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:26:55 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:55 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b 1073741824 Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94521354-ce47-46c5-bb62-5c20fe8d73a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc50a65f-3650-4736-9bfe-18adc477f8c2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10c49c5-8e69-4636-9702-38a93e27fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Volume volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 (cc50a65f-3650-4736-9bfe-18adc477f8c2): created successfully Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10c49c5-8e69-4636-9702-38a93e27fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Flow 'volume_create_manager' (c45fd8bc-efeb-4fa0-adf4-eb093e157af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1631d1fa-b414-43d3-b4a4-7ec93deb5379 tempest-AbsoluteLimitsTests-1973116131 None] Created volume successfully. Nov 03 17:26:55 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.798771ec-008a-4b45-ae7e-1c8c51bc2f16" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-798771ec-008a-4b45-ae7e-1c8c51bc2f16" released by "_delete_snapshot" :: held 1.999s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_snapshot" :: held 2.027s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:55 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Created reservations ['292ee9e3-3d77-480c-958f-0ef09730a411', '4faa5d3b-bf86-4683-936d-8ca1607e4d15', '92ac7299-8c92-45ff-b7f8-fdcedf5305bb', '38b95a88-4f3c-4fcc-8045-453641abfc27'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Delete snapshot completed successfully. Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f2e9e9f4-726d-4343-b963-e325a01dd41d tempest-SnapshotsActionsTest-271681328 None] Lock "cinder-798771ec-008a-4b45-ae7e-1c8c51bc2f16-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:56 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b 1073741824" returned: 0 in 0.487s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:56 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b Nov 03 17:26:56 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:56 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b" returned: 0 in 0.274s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fe97c1-7962-4fe4-848a-2090f435d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512e646d-763f-46ce-bd94-f95a13df176b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61f5475-0172-4d28-a330-3aa26ef8c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:26:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Volume volume-512e646d-763f-46ce-bd94-f95a13df176b (512e646d-763f-46ce-bd94-f95a13df176b): created successfully Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61f5475-0172-4d28-a330-3aa26ef8c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Flow 'volume_create_manager' (fc1b9262-f4ee-46c5-b63c-d0ab93d1e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:26:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bc3281da-3e81-4531-94e0-4b2958999f92 tempest-VolumesMetadataTest-676052412 None] Created volume successfully. Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Acquiring lock "cinder-cc50a65f-3650-4736-9bfe-18adc477f8c2-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "cinder-cc50a65f-3650-4736-9bfe-18adc477f8c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Acquiring lock "cinder-quobyte-cc50a65f-3650-4736-9bfe-18adc477f8c2" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "cinder-quobyte-cc50a65f-3650-4736-9bfe-18adc477f8c2" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c97bb9-4e38-4520-9086-a2f97417acb1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:57 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 Nov 03 17:26:57 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:57 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2" returned: 0 in 0.394s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:57 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2 Nov 03 17:26:57 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "cinder-8ae325ec-3e99-4e49-92e7-e0e0dcd33056-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:57 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cc50a65f-3650-4736-9bfe-18adc477f8c2" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "cinder-quobyte-cc50a65f-3650-4736-9bfe-18adc477f8c2" released by "delete_volume" :: held 0.750s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-8ae325ec-3e99-4e49-92e7-e0e0dcd33056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "cinder-quobyte-8ae325ec-3e99-4e49-92e7-e0e0dcd33056" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-8ae325ec-3e99-4e49-92e7-e0e0dcd33056" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Deleting offline snapshot 8ae325ec-3e99-4e49-92e7-e0e0dcd33056 of volume 2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] snapshot_file for this snap is: volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc0f6e-8315-492b-8e82-c86c3156e6c4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Created reservations ['3dacad3b-9f28-42ba-93d1-84438102914d', 'dab170fa-ee5e-4601-bfda-d585d89dfa65', '18b434a5-4d05-4554-ab7e-6403895fb3c6', '246be67c-60d5-45bd-857b-a433ec662084'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:57 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:57 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:57 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:57 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:58 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Deleted volume successfully. Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-eae92578-d3ee-4d34-bbed-30ffc0cfed60 tempest-AbsoluteLimitsTests-1973116131 None] Lock "cinder-cc50a65f-3650-4736-9bfe-18adc477f8c2-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:58 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Acquiring lock "cinder-512e646d-763f-46ce-bd94-f95a13df176b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[292be035-ca94-4c8e-b027-30a71eb3aca0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "cinder-512e646d-763f-46ce-bd94-f95a13df176b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Acquiring lock "cinder-quobyte-512e646d-763f-46ce-bd94-f95a13df176b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "cinder-quobyte-512e646d-763f-46ce-bd94-f95a13df176b" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3899c3d1-8d7f-4eaa-a64e-e2f7a920030f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:58 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 Nov 03 17:26:58 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:58 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b Nov 03 17:26:58 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:58 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:58 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:58 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:58 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b" returned: 0 in 0.407s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:58 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b Nov 03 17:26:58 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:59 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:59 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-512e646d-763f-46ce-bd94-f95a13df176b" returned: 0 in 0.287s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "cinder-quobyte-512e646d-763f-46ce-bd94-f95a13df176b" released by "delete_volume" :: held 0.744s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:59 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056 Nov 03 17:26:59 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Created reservations ['3c56130f-fde2-4fb4-b86f-179e091dd60c', 'aafaa5bf-68bd-4233-a8df-171213b788a9', 'fba2c5eb-6f83-4c58-8683-af15509e1d0b', '6648dba0-ba10-4958-94f5-5f840444e12e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:26:59 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:26:59 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:26:59 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8.8ae325ec-3e99-4e49-92e7-e0e0dcd33056" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-8ae325ec-3e99-4e49-92e7-e0e0dcd33056" released by "_delete_snapshot" :: held 1.713s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_snapshot" :: held 1.751s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Created reservations ['9d7e9377-c726-4453-9828-de4f6f7e4388', 'ede35b2c-553d-4f74-8e84-52940599d44b', '3016ef3c-883a-494d-b73d-e1986ed6157b', '1e193324-dddf-48c1-b817-aaa57eacaa62'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:26:59 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.326s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:26:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Deleted volume successfully. Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1ef87c28-f1ce-440b-a5c8-3cf796514739 tempest-VolumesMetadataTest-676052412 None] Lock "cinder-512e646d-763f-46ce-bd94-f95a13df176b-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Delete snapshot completed successfully. Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-22b8e72c-7a29-49f2-8bec-44ffd32cb2af tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-8ae325ec-3e99-4e49-92e7-e0e0dcd33056-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "cinder-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:26:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[317604c4-44e0-4101-b985-f4aa479f9647]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:00 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 Nov 03 17:27:00 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:00 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" returned: 0 in 0.402s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:00 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8 Nov 03 17:27:00 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:00 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-quobyte-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8" released by "delete_volume" :: held 0.770s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Created reservations ['fc0938a1-64e2-4b79-928f-630ee0958051', 'd9511c18-3cc6-4424-97ae-ea443aa37593', '49165374-f085-4fdf-aa11-ac675b23b558', 'c13cc7cf-a3c3-4da0-9eee-f0695330f0b1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:00 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:00 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:01 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.378s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:01 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Deleted volume successfully. Nov 03 17:27:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2530f02a-35b7-4ce6-b776-05841dbb7e7e tempest-SnapshotsActionsTest-1640310559 None] Lock "cinder-2bdd9afb-3783-4f1f-90e8-ad82324ea4c8-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Flow 'volume_create_manager' (7447c171-9e97-4e12-84a2-17315bffc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd53f49-5ecd-4b38-8aa2-5341d18aeaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd53f49-5ecd-4b38-8aa2-5341d18aeaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-412189040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21765173-0200-4759-a229-32f198a665f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f915ab000e54b1e9e754cf09d5ad255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:07Z,use_quota=True,user_id='5862225e045847d8a61d66674c4ea454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ea8221-c328-4703-8f39-2ec989d9314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ea8221-c328-4703-8f39-2ec989d9314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f97e5b-e165-4817-be15-0d2a4f37ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f97e5b-e165-4817-be15-0d2a4f37ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21765173-0200-4759-a229-32f198a665f6', 'volume_name': 'volume-21765173-0200-4759-a229-32f198a665f6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f93f6b-73c6-4f13-baa2-139912fdf885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f93f6b-73c6-4f13-baa2-139912fdf885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265e8ea8-358f-469d-a985-42fd6ce1dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Volume 21765173-0200-4759-a229-32f198a665f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21765173-0200-4759-a229-32f198a665f6', 'volume_size': 1} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-412189040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21765173-0200-4759-a229-32f198a665f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f915ab000e54b1e9e754cf09d5ad255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:07Z,use_quota=True,user_id='5862225e045847d8a61d66674c4ea454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Creating volume 21765173-0200-4759-a229-32f198a665f6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:06 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:06 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 1073741824 Nov 03 17:27:06 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Flow 'volume_create_manager' (5f1d6cc8-ac22-47ce-bf7e-ae1f9d90c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83afaf99-83e1-404e-b8bb-d30edb6231a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83afaf99-83e1-404e-b8bb-d30edb6231a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1732055236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af69433c57f418b8d292b84e4d9054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:07Z,use_quota=True,user_id='1ae503dac72c41e7a7a7a2a9fc168dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a1c0ca-b337-4275-a61d-cb00fcd8a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a1c0ca-b337-4275-a61d-cb00fcd8a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e28aa1-eb9c-4181-aeba-96939322bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e28aa1-eb9c-4181-aeba-96939322bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9', 'volume_name': 'volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346c5445-d4fa-4be7-af9f-dd0de73d52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346c5445-d4fa-4be7-af9f-dd0de73d52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2ddc2e-9c65-4097-a5d6-ecad7bb2be1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:07 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Volume 6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9', 'volume_size': 1} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:07 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 1073741824" returned: 0 in 0.579s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:07 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 Nov 03 17:27:07 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:07 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6" returned: 0 in 0.444s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1732055236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af69433c57f418b8d292b84e4d9054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:07Z,use_quota=True,user_id='1ae503dac72c41e7a7a7a2a9fc168dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Creating volume 6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:08 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265e8ea8-358f-469d-a985-42fd6ce1dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21765173-0200-4759-a229-32f198a665f6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:08 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 1073741824 Nov 03 17:27:08 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9c4fc8-4812-4c8a-b293-effb2af30e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Volume volume-21765173-0200-4759-a229-32f198a665f6 (21765173-0200-4759-a229-32f198a665f6): created successfully Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9c4fc8-4812-4c8a-b293-effb2af30e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Flow 'volume_create_manager' (7447c171-9e97-4e12-84a2-17315bffc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-38e20e35-6fb9-40cc-bbd1-6f33551920bd tempest-VolumesTransfersV357Test-313181936 None] Created volume successfully. Nov 03 17:27:08 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 1073741824" returned: 0 in 0.679s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:08 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 Nov 03 17:27:08 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:09 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2ddc2e-9c65-4097-a5d6-ecad7bb2be1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0af770-8c6b-4dcb-908b-32a240afd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:09 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Volume volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 (6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9): created successfully Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0af770-8c6b-4dcb-908b-32a240afd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Flow 'volume_create_manager' (5f1d6cc8-ac22-47ce-bf7e-ae1f9d90c802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-db31509b-90a8-42e1-8fd9-50c358ea903b tempest-VolumesTransfersV355Test-1660588755 None] Created volume successfully. Nov 03 17:27:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5ac5fcdb-7668-4239-8c4c-abf6da10a4f3 tempest-VolumesTransfersV357Test-598175153 None] Transfer volume completed successfully. Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "cinder-21765173-0200-4759-a229-32f198a665f6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-21765173-0200-4759-a229-32f198a665f6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "cinder-quobyte-21765173-0200-4759-a229-32f198a665f6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-quobyte-21765173-0200-4759-a229-32f198a665f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b28869-7ac9-4724-858b-8ffdbc6e77c5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:11 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 Nov 03 17:27:11 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:11 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6" returned: 0 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-962ab81a-0e8a-4e6a-9368-d8f8cd594d5c tempest-VolumesTransfersV355Test-1274976180 None] Transfer volume completed successfully. Nov 03 17:27:11 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6 Nov 03 17:27:11 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:11 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-21765173-0200-4759-a229-32f198a665f6" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-quobyte-21765173-0200-4759-a229-32f198a665f6" released by "delete_volume" :: held 0.965s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:11 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Created reservations ['485706cb-9603-4829-a3f9-da191f1f4960', '67f55192-89b3-4f1d-bd38-c44312f72fc2', 'e6f44b51-6161-40a1-8304-25819394d462', '63aa787e-4736-4d3c-b501-6a9be29c711b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:12 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:12 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "cinder-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-29030972-d80b-4cbc-a265-97f39830fe24 req-76bf2513-2235-4d09-95c0-e2a1b996765c tempest-AttachVolumeNegativeTest-1927615303 None] Terminate volume connection completed successfully. Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-29030972-d80b-4cbc-a265-97f39830fe24 req-76bf2513-2235-4d09-95c0-e2a1b996765c tempest-AttachVolumeNegativeTest-1927615303 None] Deleting attachment 9d2de7d1-b8a4-4cdc-acf3-f8b928d110d4. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "cinder-quobyte-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:12 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.372s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-quobyte-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Deleted volume successfully. Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e871c-18a7-44ff-8004-d725a17c2fe7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c97828e6-1bfc-431b-aac7-6b528b5a907e tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-21765173-0200-4759-a229-32f198a665f6-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:12 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 Nov 03 17:27:12 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:12 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" returned: 0 in 0.401s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:12 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9 Nov 03 17:27:12 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:13 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" returned: 0 in 0.321s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-quobyte-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9" released by "delete_volume" :: held 0.787s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Created reservations ['81789fa4-2b9f-4783-ac0b-db1a40f4e8da', 'e13af6d4-da5a-46b7-980b-5a6411834ade', '03a3b576-f0fa-46bf-8a12-da4dd06406a3', 'b7ee8c66-10fb-4148-a303-708ea3159c03'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:13 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:13 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Flow 'volume_create_manager' (1f4196fc-3b60-4c0e-a46f-bf9e7e537692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39788c09-bb40-4616-88cc-5c3d4ec8696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39788c09-bb40-4616-88cc-5c3d4ec8696a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-376679852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f24d68-fca3-4e3a-a399-dd1e9eab02f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f915ab000e54b1e9e754cf09d5ad255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:14Z,use_quota=True,user_id='5862225e045847d8a61d66674c4ea454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67819c83-2fe1-4c95-ba9c-90b3f6777169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67819c83-2fe1-4c95-ba9c-90b3f6777169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e1d7e4-d47d-45b0-ada1-a8e4a9213c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e1d7e4-d47d-45b0-ada1-a8e4a9213c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f24d68-fca3-4e3a-a399-dd1e9eab02f7', 'volume_name': 'volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4eecc1-889e-4392-9ab0-867b6ed3a54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4eecc1-889e-4392-9ab0-867b6ed3a54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f344e5f-4f1a-4708-9403-ace79b4d41ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Volume 06f24d68-fca3-4e3a-a399-dd1e9eab02f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7', 'volume_size': 1} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-376679852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f24d68-fca3-4e3a-a399-dd1e9eab02f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f915ab000e54b1e9e754cf09d5ad255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:14Z,use_quota=True,user_id='5862225e045847d8a61d66674c4ea454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Creating volume 06f24d68-fca3-4e3a-a399-dd1e9eab02f7 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.771s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Deleted volume successfully. Nov 03 17:27:14 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 1073741824 Nov 03 17:27:14 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-37b794dc-2290-47b2-bef9-70e463acd043 tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-6fbfd12f-4f4b-4fe4-a04c-62b33450ceb9-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Flow 'volume_create_manager' (9ffaee85-3009-4e40-95f4-06868d53cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae741f8-e292-4528-8cb5-0e7fa8c47878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae741f8-e292-4528-8cb5-0e7fa8c47878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1953038951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17395fc-dfb0-4f07-b8d9-058c65d7d34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af69433c57f418b8d292b84e4d9054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:14Z,use_quota=True,user_id='1ae503dac72c41e7a7a7a2a9fc168dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691d4acc-1f8f-4320-85b9-4246741f08d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691d4acc-1f8f-4320-85b9-4246741f08d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1ef58b-ae0e-45ef-917d-54ad9f9752d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1ef58b-ae0e-45ef-917d-54ad9f9752d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17395fc-dfb0-4f07-b8d9-058c65d7d34e', 'volume_name': 'volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e910b0-aa2b-46aa-ba61-d17db8e342be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e910b0-aa2b-46aa-ba61-d17db8e342be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042fe6bc-af26-4498-8fd1-c1ceb871b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Volume b17395fc-dfb0-4f07-b8d9-058c65d7d34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e', 'volume_size': 1} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:14 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 1073741824" returned: 0 in 0.642s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:14 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 Nov 03 17:27:14 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:15 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" returned: 0 in 0.299s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1953038951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17395fc-dfb0-4f07-b8d9-058c65d7d34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af69433c57f418b8d292b84e4d9054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:14Z,use_quota=True,user_id='1ae503dac72c41e7a7a7a2a9fc168dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Creating volume b17395fc-dfb0-4f07-b8d9-058c65d7d34e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:15 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f344e5f-4f1a-4708-9403-ace79b4d41ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:15 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e 1073741824 Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46f0949-1c2c-4395-964b-63f22d0ba977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:15 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Volume volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 (06f24d68-fca3-4e3a-a399-dd1e9eab02f7): created successfully Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46f0949-1c2c-4395-964b-63f22d0ba977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Flow 'volume_create_manager' (1f4196fc-3b60-4c0e-a46f-bf9e7e537692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3ecec48d-67d1-4103-8224-d4983ffec38a tempest-VolumesTransfersV357Test-313181936 None] Created volume successfully. Nov 03 17:27:15 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e 1073741824" returned: 0 in 0.586s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:15 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e Nov 03 17:27:15 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:16 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" returned: 0 in 0.358s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042fe6bc-af26-4498-8fd1-c1ceb871b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc14c613-3289-4ef0-bfbf-a5c8037f6fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Volume volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e (b17395fc-dfb0-4f07-b8d9-058c65d7d34e): created successfully Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc14c613-3289-4ef0-bfbf-a5c8037f6fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Flow 'volume_create_manager' (9ffaee85-3009-4e40-95f4-06868d53cc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-61e12477-8381-4527-bc6b-a520291152c7 tempest-VolumesTransfersV355Test-1660588755 None] Created volume successfully. Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "cinder-06f24d68-fca3-4e3a-a399-dd1e9eab02f7-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-06f24d68-fca3-4e3a-a399-dd1e9eab02f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "cinder-quobyte-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-quobyte-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[91143619-ac23-4cf3-aaed-0b5d43c92312]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:16 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 Nov 03 17:27:16 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "cinder-b17395fc-dfb0-4f07-b8d9-058c65d7d34e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:17 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" returned: 0 in 0.524s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-b17395fc-dfb0-4f07-b8d9-058c65d7d34e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:17 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7 Nov 03 17:27:17 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "cinder-quobyte-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-quobyte-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da76eaa-c386-4872-be90-b5168eaa324f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:17 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e Nov 03 17:27:17 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" returned: 0 in 0.354s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-quobyte-06f24d68-fca3-4e3a-a399-dd1e9eab02f7" released by "delete_volume" :: held 0.957s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Created reservations ['a54e909d-ac8b-41bd-98bc-67fee419a65f', '2292d53c-8309-44bb-a296-6750fc25544f', 'd21ed052-9da9-4937-877c-ca7abdb5879f', '97812d8e-3175-4d62-8852-3d4560660302'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:17 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" returned: 0 in 0.481s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:17 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e Nov 03 17:27:17 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:17 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Flow 'volume_create_manager' (5ff4c2df-c186-4496-9649-d1c81a8baf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c407c93-dbba-4684-8f20-0d8742cc195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c407c93-dbba-4684-8f20-0d8742cc195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1946213504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec770832-3ef9-4394-9a5a-97f286fbc19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94796f2cacff450ab59c7e9d4b31285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:18Z,use_quota=True,user_id='96013ca92bd94795b21d2db7d7007918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cc9f71-efb8-4ba4-925e-dcdc7370c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cc9f71-efb8-4ba4-925e-dcdc7370c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bdcd6e-953a-449b-ad74-5a5a1d46947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bdcd6e-953a-449b-ad74-5a5a1d46947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec770832-3ef9-4394-9a5a-97f286fbc19c', 'volume_name': 'volume-ec770832-3ef9-4394-9a5a-97f286fbc19c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0bd485-d9ab-4796-9055-5a720e889099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0bd485-d9ab-4796-9055-5a720e889099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2866879e-5885-4706-81f7-3b78662b7cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Volume ec770832-3ef9-4394-9a5a-97f286fbc19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec770832-3ef9-4394-9a5a-97f286fbc19c', 'volume_size': 1} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1946213504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec770832-3ef9-4394-9a5a-97f286fbc19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94796f2cacff450ab59c7e9d4b31285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:18Z,use_quota=True,user_id='96013ca92bd94795b21d2db7d7007918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Creating volume ec770832-3ef9-4394-9a5a-97f286fbc19c {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:17 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c 1073741824 Nov 03 17:27:17 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:17 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-quobyte-b17395fc-dfb0-4f07-b8d9-058c65d7d34e" released by "delete_volume" :: held 0.856s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:17 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.351s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Deleted volume successfully. Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Created reservations ['0e7bd720-9eb8-49a8-bc0c-abb8369667fe', 'efd5de11-2b43-4cf7-9de5-f7748832c60b', '68c155ab-cf40-443e-ba45-42eefc444651', 'd1116fb8-4e93-4be7-82df-fc1c52ea26e3'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf510977-d46c-4bdb-aeb0-f43c2b71ce2a tempest-VolumesTransfersV357Test-2046653914 None] Lock "cinder-06f24d68-fca3-4e3a-a399-dd1e9eab02f7-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:18 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:18 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:18 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c 1073741824" returned: 0 in 0.599s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:18 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.349s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Deleted volume successfully. Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-df3a0bb1-c816-4239-b883-9d2bb909de9f tempest-VolumesTransfersV355Test-483353565 None] Lock "cinder-b17395fc-dfb0-4f07-b8d9-058c65d7d34e-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:18 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c Nov 03 17:27:18 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:18 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c" returned: 0 in 0.413s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2866879e-5885-4706-81f7-3b78662b7cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec770832-3ef9-4394-9a5a-97f286fbc19c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef67d74b-3930-461d-a5e7-d29e6af9f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Volume volume-ec770832-3ef9-4394-9a5a-97f286fbc19c (ec770832-3ef9-4394-9a5a-97f286fbc19c): created successfully Nov 03 17:27:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef67d74b-3930-461d-a5e7-d29e6af9f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Flow 'volume_create_manager' (5ff4c2df-c186-4496-9649-d1c81a8baf77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d40ab1ef-9499-4bfe-a229-3b27cfab8c9d tempest-VolumesServicesTestJSON-1461534669 None] Created volume successfully. Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Acquiring lock "cinder-ec770832-3ef9-4394-9a5a-97f286fbc19c-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "cinder-ec770832-3ef9-4394-9a5a-97f286fbc19c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Acquiring lock "cinder-quobyte-ec770832-3ef9-4394-9a5a-97f286fbc19c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "cinder-quobyte-ec770832-3ef9-4394-9a5a-97f286fbc19c" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725682b-d9a9-46bd-83aa-8a6177dd3ea9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:20 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c Nov 03 17:27:20 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:20 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c" returned: 0 in 0.425s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:20 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c Nov 03 17:27:20 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:21 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ec770832-3ef9-4394-9a5a-97f286fbc19c" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "cinder-quobyte-ec770832-3ef9-4394-9a5a-97f286fbc19c" released by "delete_volume" :: held 0.803s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Created reservations ['12c80a22-a365-4920-81a0-1e2f4963cead', '4f47442e-10f3-4d74-a264-dd6941f938cf', '74e73905-78c2-417a-bf36-0bc3f88f3a62', '3aafbd3f-302f-4d74-a106-d7fd92a79fb7'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:21 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:21 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:21 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.441s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Deleted volume successfully. Nov 03 17:27:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6dcd3aa4-4ee1-449e-9227-e6ed2a0bf6c3 tempest-VolumesServicesTestJSON-1461534669 None] Lock "cinder-ec770832-3ef9-4394-9a5a-97f286fbc19c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Flow 'volume_create_manager' (c5e4ee18-bcfa-4d42-8eac-0c0349ad8441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea38b1-6936-41d9-ab36-5098104970bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea38b1-6936-41d9-ab36-5098104970bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1680448906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c698d15-66d7-4223-95fb-d1989459d5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71640a4234b5410f81dce8ab60bc2a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:29Z,use_quota=True,user_id='a3a4f915ebc244c0a88dfa17a4921d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e64f78-b20b-4e35-baec-4c9228b56ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e64f78-b20b-4e35-baec-4c9228b56ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab32429-736d-4be7-9c00-b03e26d956ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab32429-736d-4be7-9c00-b03e26d956ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c698d15-66d7-4223-95fb-d1989459d5b4', 'volume_name': 'volume-7c698d15-66d7-4223-95fb-d1989459d5b4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed774a-9d41-4bb1-b9d4-3d1341d6f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed774a-9d41-4bb1-b9d4-3d1341d6f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b68e1e-b798-4893-b8c7-94b988cdad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Volume 7c698d15-66d7-4223-95fb-d1989459d5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c698d15-66d7-4223-95fb-d1989459d5b4', 'volume_size': 1} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1680448906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c698d15-66d7-4223-95fb-d1989459d5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71640a4234b5410f81dce8ab60bc2a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:29Z,use_quota=True,user_id='a3a4f915ebc244c0a88dfa17a4921d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Creating volume 7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:29 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:29 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 1073741824 Nov 03 17:27:29 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (c3865ffa-70af-4623-a7cf-660c3e0dd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af52d1d0-3d6e-49ca-8205-7dc751a239f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af52d1d0-3d6e-49ca-8205-7dc751a239f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1901276039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efdc115-5181-4a3c-b0d2-125dcf76ce34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:30Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be12422-0881-45ca-a8b8-ada49ed31903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be12422-0881-45ca-a8b8-ada49ed31903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9be0a-f7e5-4082-8708-4c10eb84c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9be0a-f7e5-4082-8708-4c10eb84c463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efdc115-5181-4a3c-b0d2-125dcf76ce34', 'volume_name': 'volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f0e715-8029-406b-8158-e588f0735081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f0e715-8029-406b-8158-e588f0735081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2d58e-cdca-4078-a34d-56271878ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Volume 4efdc115-5181-4a3c-b0d2-125dcf76ce34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34', 'volume_size': 1} Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:29 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 1073741824" returned: 0 in 0.725s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:30 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:30 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:30 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1901276039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efdc115-5181-4a3c-b0d2-125dcf76ce34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:30Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Creating volume 4efdc115-5181-4a3c-b0d2-125dcf76ce34 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:30 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b68e1e-b798-4893-b8c7-94b988cdad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c698d15-66d7-4223-95fb-d1989459d5b4', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:30 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 1073741824 Nov 03 17:27:30 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112415d9-81f2-4d94-a657-15145e4134a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Volume volume-7c698d15-66d7-4223-95fb-d1989459d5b4 (7c698d15-66d7-4223-95fb-d1989459d5b4): created successfully Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112415d9-81f2-4d94-a657-15145e4134a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Flow 'volume_create_manager' (c5e4ee18-bcfa-4d42-8eac-0c0349ad8441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ef2f1ab4-cd5d-457e-a07d-92d6fe1a6171 tempest-VolumesCloneTest-911199151 None] Created volume successfully. Nov 03 17:27:31 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 1073741824" returned: 0 in 0.707s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:31 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 Nov 03 17:27:31 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:32 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Flow 'volume_create_manager' (9794948f-a874-47da-a569-4dde7ec44bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45d25c3-0fad-484e-9870-fd004582a3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34" returned: 0 in 0.806s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45d25c3-0fad-484e-9870-fd004582a3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-307743522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d698a1-cc8b-4fc0-bec2-fe00e2e97919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71640a4234b5410f81dce8ab60bc2a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7c698d15-66d7-4223-95fb-d1989459d5b4,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:32Z,use_quota=True,user_id='a3a4f915ebc244c0a88dfa17a4921d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a13a68-3691-45fc-855b-280f655dfc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a13a68-3691-45fc-855b-280f655dfc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2f2b33-3c39-4cde-a010-ff7369f69cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2d58e-cdca-4078-a34d-56271878ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c1e2a5-93b8-4aba-8dcb-8322e0885ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2f2b33-3c39-4cde-a010-ff7369f69cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd5d698a1-cc8b-4fc0-bec2-fe00e2e97919', 'volume_name': 'volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919', 'volume_size': 2, 'source_volid': '7c698d15-66d7-4223-95fb-d1989459d5b4', 'source_volstatus': 'available'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124943c8-dba3-4b9b-95e5-89b506776736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124943c8-dba3-4b9b-95e5-89b506776736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e302b39-fff1-4b25-bf03-2dbb0679885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Volume d5d698a1-cc8b-4fc0-bec2-fe00e2e97919: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919', 'volume_size': 2, 'source_volid': '7c698d15-66d7-4223-95fb-d1989459d5b4', 'source_volstatus': 'available'} Nov 03 17:27:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Volume volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 (4efdc115-5181-4a3c-b0d2-125dcf76ce34): created successfully Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c1e2a5-93b8-4aba-8dcb-8322e0885ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (c3865ffa-70af-4623-a7cf-660c3e0dd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:32 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Cloning volume 7c698d15-66d7-4223-95fb-d1989459d5b4 to volume d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 Nov 03 17:27:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-87a1b86a-0683-4bef-9efb-67d47832450c tempest-VolumesListTestJSON-1262292540 None] Created volume successfully. Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Creating offline snapshot 1f30b92d-c3f1-47aa-be57-ad78e5e2e436 of volume 7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7c435-3b7e-4203-afa0-3f1170964f36]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:32 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:32 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:32 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.586s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:32 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 1G Nov 03 17:27:32 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:33 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 1G" returned: 0 in 0.665s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c698d15-66d7-4223-95fb-d1989459d5b4 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:33 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c698d15-66d7-4223-95fb-d1989459d5b4 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:33 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (8d54ca5a-bb20-485c-83ec-5938b8fc249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83769d9-fc5c-4bc3-bf98-420919077c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83769d9-fc5c-4bc3-bf98-420919077c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1061176741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9462243d-cf8e-459b-a647-2895d84290bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:34Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dc2fd4-5308-4661-b494-a3c3c3529fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dc2fd4-5308-4661-b494-a3c3c3529fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0994f71-3fde-417f-a3fd-a1422a718310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0994f71-3fde-417f-a3fd-a1422a718310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9462243d-cf8e-459b-a647-2895d84290bc', 'volume_name': 'volume-9462243d-cf8e-459b-a647-2895d84290bc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cede2819-1935-457d-bef6-4bc472c2fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cede2819-1935-457d-bef6-4bc472c2fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c074194a-f93c-469b-a8f7-bf246a270ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:33 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Volume 9462243d-cf8e-459b-a647-2895d84290bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9462243d-cf8e-459b-a647-2895d84290bc', 'volume_size': 1} Nov 03 17:27:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:34 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c698d15-66d7-4223-95fb-d1989459d5b4 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.480s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:34 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 is being set with open permissions: ugo+rw Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:34 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:34 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:34 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:34 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info Nov 03 17:27:34 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:34 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:34 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info is being set with open permissions: ugo+rw Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:34 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info Nov 03 17:27:34 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:34 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.info" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] snapshot: 1f30b92d-c3f1-47aa-be57-ad78e5e2e436, volume: d5d698a1-cc8b-4fc0-bec2-fe00e2e97919, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4979d9a5-1531-4aa4-9927-e744a4bdf79e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:35 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:35 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:35 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c698d15-66d7-4223-95fb-d1989459d5b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e23537-37a1-47b2-b430-df9d5cd8729c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:35 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:35 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:35 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.473s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:27:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:35 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 Nov 03 17:27:35 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=120,cinder:UPDATE=127,cinder:INSERT=39,cinder:DELETE=13 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=110,cinder:UPDATE=160,cinder:DELETE=10,cinder:INSERT=46 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:38 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:38 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:39 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.650s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:27:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:27:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:27:44 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" returned: 0 in 8.754s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:27:44 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Converted 1024.00 MB image at 116.95 MB/s Nov 03 17:27:44 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 is being set with open permissions: ugo+rw Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:44 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 Nov 03 17:27:44 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:44 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" released by "_copy_volume_from_snapshot" :: held 9.989s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-quobyte-1f30b92d-c3f1-47aa-be57-ad78e5e2e436" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-1f30b92d-c3f1-47aa-be57-ad78e5e2e436" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Deleting offline snapshot 1f30b92d-c3f1-47aa-be57-ad78e5e2e436 of volume 7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:27:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] snapshot_file for this snap is: volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdda681c-be13-4547-b7f2-402022f756f2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:45 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:45 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:45 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c698d15-66d7-4223-95fb-d1989459d5b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de57db3-0ad9-4f67-b8b4-a485c787a4c5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:45 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:45 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:45 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.547s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:45 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:45 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:46 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:46 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436 Nov 03 17:27:46 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (be867503-7ce5-4eab-a064-df902619ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c92bb-412c-41c9-9a29-8916e207bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c92bb-412c-41c9-9a29-8916e207bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-764621532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e9841a-5a37-4ba3-923b-4b955ea2e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c99a0c7297a4f52b5f2d46fdafaeac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:46Z,use_quota=True,user_id='52bc47a93d5a4347b8b5a75abb37e705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d3ba45-4671-42ab-8d27-2a0208192aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d3ba45-4671-42ab-8d27-2a0208192aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7207507-03d7-41a8-9604-1e1c787c165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7207507-03d7-41a8-9604-1e1c787c165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e9841a-5a37-4ba3-923b-4b955ea2e7fe', 'volume_name': 'volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debd770e-fd1a-458e-9746-776e2f80a38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debd770e-fd1a-458e-9746-776e2f80a38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d4dba9-62f9-4868-9c80-1e4e6ab3dfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe', 'volume_size': 1} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:46 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4.1f30b92d-c3f1-47aa-be57-ad78e5e2e436" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-1f30b92d-c3f1-47aa-be57-ad78e5e2e436" released by "_delete_snapshot" :: held 1.693s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.544s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.703s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1061176741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9462243d-cf8e-459b-a647-2895d84290bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:34Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Creating volume 9462243d-cf8e-459b-a647-2895d84290bc {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:46 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e302b39-fff1-4b25-bf03-2dbb0679885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919', 'volume_size': 2, 'source_volid': '7c698d15-66d7-4223-95fb-d1989459d5b4', 'source_volstatus': 'available'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc 1073741824 Nov 03 17:27:46 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424da2b8-23c3-4744-ad50-0799705e5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Volume volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 (d5d698a1-cc8b-4fc0-bec2-fe00e2e97919): created successfully Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424da2b8-23c3-4744-ad50-0799705e5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Flow 'volume_create_manager' (9794948f-a874-47da-a569-4dde7ec44bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-99eb2fa6-6785-4d19-a271-96c97a98a463 tempest-VolumesCloneTest-911199151 None] Created volume successfully. Nov 03 17:27:47 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc 1073741824" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:47 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc Nov 03 17:27:47 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:47 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc" returned: 0 in 0.246s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-764621532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e9841a-5a37-4ba3-923b-4b955ea2e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c99a0c7297a4f52b5f2d46fdafaeac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:46Z,use_quota=True,user_id='52bc47a93d5a4347b8b5a75abb37e705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Creating volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:47 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c074194a-f93c-469b-a8f7-bf246a270ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9462243d-cf8e-459b-a647-2895d84290bc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de579e7c-77a9-4bee-9471-eade6ccedc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:47 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe 1073741824 Nov 03 17:27:47 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Volume volume-9462243d-cf8e-459b-a647-2895d84290bc (9462243d-cf8e-459b-a647-2895d84290bc): created successfully Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de579e7c-77a9-4bee-9471-eade6ccedc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (8d54ca5a-bb20-485c-83ec-5938b8fc249c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a81ae40b-1722-43fa-b9e3-75da6e43f392 tempest-VolumesListTestJSON-1262292540 None] Created volume successfully. Nov 03 17:27:47 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe 1073741824" returned: 0 in 0.477s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:47 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:27:47 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "cinder-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae00d83-708d-4f98-b770-481f41dbb245]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:48 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 Nov 03 17:27:48 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:48 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d4dba9-62f9-4868-9c80-1e4e6ab3dfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ca8b7d-becc-47f9-a99f-8b3e099e0c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Volume volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe (67e9841a-5a37-4ba3-923b-4b955ea2e7fe): created successfully Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ca8b7d-becc-47f9-a99f-8b3e099e0c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (be867503-7ce5-4eab-a064-df902619ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-91fc7d61-a3fd-4c10-89df-746c946c14db tempest-VolumesDeleteCascade-866434886 None] Created volume successfully. Nov 03 17:27:48 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" returned: 0 in 0.414s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:48 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919 Nov 03 17:27:48 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:48 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" returned: 0 in 0.301s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919" released by "delete_volume" :: held 0.759s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Created reservations ['dc31752a-1ff2-408d-ade7-3c9c7aeeb855', 'b9102d19-c6a5-45f2-a854-558c275e6186', '1c94fc48-808d-466e-9cb9-52d888a5a90b', 'af8326c3-0ff4-4f39-b514-dd2662caf0e1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:48 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:48 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (55c4a76a-939a-48d0-94e4-cc5a8442c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86897f77-06a4-4197-8033-cd12dd9fe070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86897f77-06a4-4197-8033-cd12dd9fe070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-723862840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d84e8b-b60f-4dfc-83bd-4bf7227edf65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:49Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e266c24-64ac-4272-baad-7b3fb228a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e266c24-64ac-4272-baad-7b3fb228a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe0df8c-8e7a-458a-863b-14dedf986911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe0df8c-8e7a-458a-863b-14dedf986911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d84e8b-b60f-4dfc-83bd-4bf7227edf65', 'volume_name': 'volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8b50fe-956b-45fd-a140-af4a77d17b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8b50fe-956b-45fd-a140-af4a77d17b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6958132e-ba0a-4099-8956-eef6a960f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:49 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Volume d5d84e8b-b60f-4dfc-83bd-4bf7227edf65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65', 'volume_size': 1} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Creating offline snapshot 0b964ce5-2e0f-467b-98f3-1c80a43a7955 of volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4d9d0-bc29-4d15-a45e-64300ba0e4b1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:49 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Deleted volume successfully. Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-780f7f4f-d1c2-4ea9-9098-f41c162ea975 tempest-VolumesCloneTest-911199151 None] Lock "cinder-d5d698a1-cc8b-4fc0-bec2-fe00e2e97919-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-7c698d15-66d7-4223-95fb-d1989459d5b4-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:49 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:27:49 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "cinder-7c698d15-66d7-4223-95fb-d1989459d5b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Acquiring lock "cinder-quobyte-7c698d15-66d7-4223-95fb-d1989459d5b4" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-7c698d15-66d7-4223-95fb-d1989459d5b4" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6987fd1-ee68-403b-a2d4-25e1a9f582a1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:49 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:49 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:49 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:49 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 1G Nov 03 17:27:49 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:49 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.441s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:49 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4 Nov 03 17:27:49 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:50 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 1G" returned: 0 in 0.492s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:50 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:50 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:50 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c698d15-66d7-4223-95fb-d1989459d5b4" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "cinder-quobyte-7c698d15-66d7-4223-95fb-d1989459d5b4" released by "delete_volume" :: held 0.793s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Created reservations ['a56d8333-cf82-4553-b2dd-e32664907532', '2adb01dc-2fcd-4a14-95b5-ef806507b753', 'b734d33d-0af4-4c02-b328-cf4f44ce57f7', 'bf3e0bb4-a144-40c4-8f7b-1127c02c10de'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:50 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:50 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:50 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.374s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:50 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 is being set with open permissions: ugo+rw Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:50 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:50 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:50 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.292s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Deleted volume successfully. Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-33b62c89-956c-4ea1-a76a-0c4f90fe9830 tempest-VolumesCloneTest-911199151 None] Lock "cinder-7c698d15-66d7-4223-95fb-d1989459d5b4-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:50 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.351s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:50 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info Nov 03 17:27:50 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:51 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info" returned: 0 in 0.311s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:51 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info is being set with open permissions: ugo+rw Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:51 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info Nov 03 17:27:51 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:51 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.info" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.395s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-723862840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d84e8b-b60f-4dfc-83bd-4bf7227edf65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04a6c4a1ee824424bb3bcc5528a5e8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:49Z,use_quota=True,user_id='ba0c380fc05a4e8284877ee256940ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Creating volume d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:51 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:51 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 1073741824 Nov 03 17:27:51 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7767bb38-87ec-4c57-91e8-5227bf29892c tempest-VolumesDeleteCascade-866434886 None] Create snapshot completed successfully Nov 03 17:27:51 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 1073741824" returned: 0 in 0.520s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:52 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 Nov 03 17:27:52 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:52 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" returned: 0 in 0.328s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.129s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Creating offline snapshot fc1b8644-d771-4582-94f0-c88ea1cb755c of volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6958132e-ba0a-4099-8956-eef6a960f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2b4584-654b-4575-be8c-f72750f3691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c09d8a-c4dc-49d0-b635-b5270a869a7b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:52 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Volume volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 (d5d84e8b-b60f-4dfc-83bd-4bf7227edf65): created successfully Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2b4584-654b-4575-be8c-f72750f3691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Flow 'volume_create_manager' (55c4a76a-939a-48d0-94e4-cc5a8442c84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5db48afd-6a5b-4929-811a-c1af6fa335ac tempest-VolumesListTestJSON-1262292540 None] Created volume successfully. Nov 03 17:27:52 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:52 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:52 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:52 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c 1G Nov 03 17:27:52 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (cbd0e087-f295-426b-b04d-3e10719fdf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9d0c50-25e9-4de1-8fde-5931907a4d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9d0c50-25e9-4de1-8fde-5931907a4d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-373477116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d01b90-d0af-455f-80e0-9da47b0e1ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:53Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda81403-6632-4117-824a-4972f11ee12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda81403-6632-4117-824a-4972f11ee12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70ea21-4f83-4611-a82a-7b7fc35b53bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70ea21-4f83-4611-a82a-7b7fc35b53bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d01b90-d0af-455f-80e0-9da47b0e1ba6', 'volume_name': 'volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f283cc11-03ac-4d63-a05a-131537197a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f283cc11-03ac-4d63-a05a-131537197a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f309b76e-0e3e-4de9-a8a1-509729a8779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:53 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Volume 51d01b90-d0af-455f-80e0-9da47b0e1ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6', 'volume_size': 1} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:53 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c 1G" returned: 0 in 0.693s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:53 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:27:53 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:54 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.419s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:54 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c is being set with open permissions: ugo+rw Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:54 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:27:54 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:54 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-373477116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d01b90-d0af-455f-80e0-9da47b0e1ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:27:53Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Creating volume 51d01b90-d0af-455f-80e0-9da47b0e1ba6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:27:54 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:54 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 1073741824 Nov 03 17:27:54 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5d735b66-8e6b-47d3-b323-8241d94a87cd tempest-VolumesDeleteCascade-866434886 None] Create snapshot completed successfully Nov 03 17:27:54 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 1073741824" returned: 0 in 0.587s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:55 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 Nov 03 17:27:55 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:55 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f309b76e-0e3e-4de9-a8a1-509729a8779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7278c06b-9a8e-4540-b9d4-a31d617082fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:27:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Volume volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 (51d01b90-d0af-455f-80e0-9da47b0e1ba6): created successfully Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7278c06b-9a8e-4540-b9d4-a31d617082fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (cbd0e087-f295-426b-b04d-3e10719fdf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:27:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3a90c09a-ec1c-4fa5-8fd9-27ec6e8dc96f tempest-AttachVolumeNegativeTest-1927615303 None] Created volume successfully. Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-67e9841a-5a37-4ba3-923b-4b955ea2e7fe-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-67e9841a-5a37-4ba3-923b-4b955ea2e7fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Performing cascade delete. {{(pid=86995) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-0b964ce5-2e0f-467b-98f3-1c80a43a7955-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-0b964ce5-2e0f-467b-98f3-1c80a43a7955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-0b964ce5-2e0f-467b-98f3-1c80a43a7955" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-0b964ce5-2e0f-467b-98f3-1c80a43a7955" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Deleting offline snapshot 0b964ce5-2e0f-467b-98f3-1c80a43a7955 of volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] snapshot_file for this snap is: volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f48737c-48a1-48fc-873a-f86a5e5426c0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-quobyte-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dabb1a-850c-4a9f-bdd3-ef90cd171fa9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:55 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:55 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:56 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 Nov 03 17:27:56 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:56 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.515s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f1d55-f32b-45a6-9f3d-668a0597d7ce]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:56 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" returned: 0 in 0.480s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:56 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65 Nov 03 17:27:56 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:56 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:27:56 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:56 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" returned: 0 in 0.345s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65" released by "delete_volume" :: held 0.876s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Created reservations ['dc8e78c9-4970-40b1-8e01-1eef8f70ea55', '2be7d4ef-79e7-4e69-90c6-0c6235ec5231', '2a6270be-1b5d-480f-bf61-2d956b19e201', '401fe894-83aa-43a9-b278-17ed525cd060'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:56 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.524s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc42993-bb3e-4b45-ab2e-c1fd5dd42acc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:57 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:27:57 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:57 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:57 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-adee8ef7-aa26-4bcc-9eef-180f88a0520e req-05fcdba9-9ffc-45d4-bcff-8bdc071a75d8 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-adee8ef7-aa26-4bcc-9eef-180f88a0520e req-05fcdba9-9ffc-45d4-bcff-8bdc071a75d8 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-adee8ef7-aa26-4bcc-9eef-180f88a0520e req-05fcdba9-9ffc-45d4-bcff-8bdc071a75d8 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-adee8ef7-aa26-4bcc-9eef-180f88a0520e req-05fcdba9-9ffc-45d4-bcff-8bdc071a75d8 tempest-AttachVolumeNegativeTest-1927615303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f6016ce-e0e8-4b63-be45-f134eef0a421', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:27:57 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.382s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Deleted volume successfully. Nov 03 17:27:57 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.535s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-adee8ef7-aa26-4bcc-9eef-180f88a0520e req-05fcdba9-9ffc-45d4-bcff-8bdc071a75d8 tempest-AttachVolumeNegativeTest-1927615303 None] attachment_update completed successfully. Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a5db7d39-c704-46e5-98dd-d1be356edd25 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-d5d84e8b-b60f-4dfc-83bd-4bf7227edf65-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebbc0cc-3e09-4988-8fb2-3a86644af1e9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:57 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:57 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:58 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.501s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28210e-87c3-4973-8752-c18b76ba8557]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:58 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:27:58 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-9462243d-cf8e-459b-a647-2895d84290bc-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-9462243d-cf8e-459b-a647-2895d84290bc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-quobyte-9462243d-cf8e-459b-a647-2895d84290bc" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-9462243d-cf8e-459b-a647-2895d84290bc" acquired by "delete_volume" :: waited 0.053s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f1f4a-f55e-4493-8b6b-44ad0aad7d70]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:58 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc Nov 03 17:27:58 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:58 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.593s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:58 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:58 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:58 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc" returned: 0 in 0.474s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:58 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc Nov 03 17:27:58 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:59 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.403s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:59 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955 Nov 03 17:27:59 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:59 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9462243d-cf8e-459b-a647-2895d84290bc" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-9462243d-cf8e-459b-a647-2895d84290bc" released by "delete_volume" :: held 0.811s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Created reservations ['26f11a67-93fe-41bb-8122-d76492b978f7', 'b2c8e441-6479-4746-9f19-4a2f37db8019', 'c1544e6c-ad4d-4c00-afc4-ff50125b955a', '4769bf1a-734d-4196-b588-6f8d4fa92037'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:59 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.0b964ce5-2e0f-467b-98f3-1c80a43a7955" returned: 0 in 0.476s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c -F qcow2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:59 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:27:59 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:59 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c -F qcow2 Nov 03 17:27:59 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-4efdc115-5181-4a3c-b0d2-125dcf76ce34-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-4efdc115-5181-4a3c-b0d2-125dcf76ce34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "cinder-quobyte-4efdc115-5181-4a3c-b0d2-125dcf76ce34" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-4efdc115-5181-4a3c-b0d2-125dcf76ce34" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae3878-14d3-4126-b115-0b2d6d9673a6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:27:59 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.383s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:27:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Deleted volume successfully. Nov 03 17:27:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e210e3bc-345d-4733-b325-253a9ac3bc99 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-9462243d-cf8e-459b-a647-2895d84290bc-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:00 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 Nov 03 17:28:00 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:00 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c -F qcow2" returned: 0 in 0.549s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-0b964ce5-2e0f-467b-98f3-1c80a43a7955" released by "_delete_snapshot" :: held 4.412s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" released by "delete_snapshot" :: held 4.445s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Created reservations ['e4220512-8d1e-48f8-9675-f21e621b13c7', '1b03a954-439a-4319-bccd-a59eed9b156c', '9c47df28-605b-42fd-8f91-c6cceb761a82', 'f4f98226-4527-47ee-af85-a6951dc8d496'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Delete snapshot completed successfully. Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-0b964ce5-2e0f-467b-98f3-1c80a43a7955-delete_snapshot" released by "delete_snapshot" :: held 4.745s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-fc1b8644-d771-4582-94f0-c88ea1cb755c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-fc1b8644-d771-4582-94f0-c88ea1cb755c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:00 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34" returned: 0 in 0.594s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-fc1b8644-d771-4582-94f0-c88ea1cb755c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:00 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34 Nov 03 17:28:00 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-fc1b8644-d771-4582-94f0-c88ea1cb755c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Deleting offline snapshot fc1b8644-d771-4582-94f0-c88ea1cb755c of volume 67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] snapshot_file for this snap is: volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e3262-e38c-445f-8f75-68aad3387758]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:00 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:28:00 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-af0b0952-7b1d-40c4-b7ed-824ef5af3073 req-6133fe0e-01ca-41c9-80a3-28773ebefda2 tempest-AttachVolumeNegativeTest-1927615303 None] Terminate volume connection completed successfully. Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-af0b0952-7b1d-40c4-b7ed-824ef5af3073 req-6133fe0e-01ca-41c9-80a3-28773ebefda2 tempest-AttachVolumeNegativeTest-1927615303 None] Deleting attachment 3f6016ce-e0e8-4b63-be45-f134eef0a421. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:28:00 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4efdc115-5181-4a3c-b0d2-125dcf76ce34" returned: 0 in 0.373s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-quobyte-4efdc115-5181-4a3c-b0d2-125dcf76ce34" released by "delete_volume" :: held 1.049s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:00 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Created reservations ['086f619f-c066-4fed-ae99-f4dee000d4af', '2ea37865-0de7-4ecd-8b25-6670856a41c3', 'e7560016-aa54-48af-8146-21ab4d44925a', '53f97aee-21a3-447d-9d10-ee0e1f3d1d1d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:01 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:01 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:01 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.655s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a513c3-6f1c-40b0-a1c2-9a7d92ab91f6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:01 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:28:01 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:01 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.427s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Deleted volume successfully. Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dc52b632-300c-44ab-9aa0-b557ca0d0922 tempest-VolumesListTestJSON-1262292540 None] Lock "cinder-4efdc115-5181-4a3c-b0d2-125dcf76ce34-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:01 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.488s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:01 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:28:01 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:02 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.770s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:02 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c Nov 03 17:28:02 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:02 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe.fc1b8644-d771-4582-94f0-c88ea1cb755c" returned: 0 in 0.384s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-fc1b8644-d771-4582-94f0-c88ea1cb755c" released by "_delete_snapshot" :: held 2.451s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" released by "delete_snapshot" :: held 2.494s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Created reservations ['09476a2a-ce0a-492c-b90a-a27852204e6d', '77f3bcb1-50a7-45ae-909f-1dbe1674153e', 'e19cd574-a3b5-44a1-b26f-94f2e25d12cf', '76bf6759-7a6a-42ae-8e4f-0c910c58d12d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Delete snapshot completed successfully. Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-fc1b8644-d771-4582-94f0-c88ea1cb755c-delete_snapshot" released by "delete_snapshot" :: held 2.791s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Snapshots deleted, issuing volume delete {{(pid=86995) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" acquired by "delete_volume" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f2363-b152-4171-974e-3152654c361c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:03 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:28:03 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:03 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.504s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:03 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe Nov 03 17:28:03 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:04 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-67e9841a-5a37-4ba3-923b-4b955ea2e7fe" released by "delete_volume" :: held 0.914s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Created reservations ['8821011f-a55f-49a7-9968-8f202af2a0c3', 'e96cfd81-da3a-446a-ac2f-6a6c37770c7d', 'c359263c-299c-4056-9e02-78a93a9db998', 'eddf3079-3ff1-4aaa-9653-ad26b04bd13a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:04 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:04 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:04 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Deleted volume successfully. Nov 03 17:28:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fee33c3e-767f-492a-98b9-45e28a7462d7 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-67e9841a-5a37-4ba3-923b-4b955ea2e7fe-delete_volume" released by "delete_volume" :: held 9.182s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (4bd6d329-914d-4144-b7cf-322a420c2c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f1e9ff-2b0e-4fd1-ac3b-08659d56df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f1e9ff-2b0e-4fd1-ac3b-08659d56df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409309494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727643cb-d995-4d20-aab8-a3596f1cee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c99a0c7297a4f52b5f2d46fdafaeac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:06Z,use_quota=True,user_id='52bc47a93d5a4347b8b5a75abb37e705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea14508-af89-4fe4-81eb-5e7802c1b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea14508-af89-4fe4-81eb-5e7802c1b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476e6b04-c858-4263-be6c-1d8ca67efe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476e6b04-c858-4263-be6c-1d8ca67efe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727643cb-d995-4d20-aab8-a3596f1cee25', 'volume_name': 'volume-727643cb-d995-4d20-aab8-a3596f1cee25', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86437225-3b7a-4c99-a551-1c46b1ba5d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86437225-3b7a-4c99-a551-1c46b1ba5d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae2ba8-763f-4c47-ae45-c25a9ab98815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:05 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Volume 727643cb-d995-4d20-aab8-a3596f1cee25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727643cb-d995-4d20-aab8-a3596f1cee25', 'volume_size': 1} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409309494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727643cb-d995-4d20-aab8-a3596f1cee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c99a0c7297a4f52b5f2d46fdafaeac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:06Z,use_quota=True,user_id='52bc47a93d5a4347b8b5a75abb37e705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Creating volume 727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:05 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:05 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 1073741824 Nov 03 17:28:05 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:06 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 1073741824" returned: 0 in 0.693s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:06 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:06 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:06 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae2ba8-763f-4c47-ae45-c25a9ab98815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727643cb-d995-4d20-aab8-a3596f1cee25', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2595d209-804c-4c0f-bab0-03e1ca4c805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Volume volume-727643cb-d995-4d20-aab8-a3596f1cee25 (727643cb-d995-4d20-aab8-a3596f1cee25): created successfully Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2595d209-804c-4c0f-bab0-03e1ca4c805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (4bd6d329-914d-4144-b7cf-322a420c2c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:07 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ba3b8991-ba2f-44a3-8d29-8cc8d584d6f0 tempest-VolumesDeleteCascade-866434886 None] Created volume successfully. Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Creating offline snapshot 1faa9637-4ef3-4c6f-a838-745a14047abf of volume 727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3beae2-67bb-4518-9c99-660db6c02324]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:08 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:08 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:08 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.572s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:08 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf 1G Nov 03 17:28:08 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:09 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf 1G" returned: 0 in 0.622s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727643cb-d995-4d20-aab8-a3596f1cee25 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:09 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727643cb-d995-4d20-aab8-a3596f1cee25 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:09 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:09 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727643cb-d995-4d20-aab8-a3596f1cee25 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.403s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:09 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf is being set with open permissions: ugo+rw Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:09 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:09 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:09 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:10 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info Nov 03 17:28:10 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:10 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:10 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info is being set with open permissions: ugo+rw Nov 03 17:28:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:10 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info Nov 03 17:28:10 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:10 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.info" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0bd23ae8-e6e9-4f89-b789-b9786e75631c tempest-VolumesDeleteCascade-866434886 None] Create snapshot completed successfully Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (feb749c6-4f3a-4c85-81a2-433b27bac789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650431f8-bb95-46ce-8624-342da83f07d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650431f8-bb95-46ce-8624-342da83f07d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1637707707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec505b0-e845-4780-919b-6eaa318b2eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c99a0c7297a4f52b5f2d46fdafaeac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1faa9637-4ef3-4c6f-a838-745a14047abf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:12Z,use_quota=True,user_id='52bc47a93d5a4347b8b5a75abb37e705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2723da9d-1dcf-4fab-ae7b-7cbf37d9b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2723da9d-1dcf-4fab-ae7b-7cbf37d9b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fd898f-52d5-4e4f-8ee5-b2194c26aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fd898f-52d5-4e4f-8ee5-b2194c26aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ec505b0-e845-4780-919b-6eaa318b2eaa', 'volume_name': 'volume-2ec505b0-e845-4780-919b-6eaa318b2eaa', 'volume_size': 1, 'snapshot_id': '1faa9637-4ef3-4c6f-a838-745a14047abf'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7cff36-32e5-4d46-8b4c-cb659df999a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7cff36-32e5-4d46-8b4c-cb659df999a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0feafcf-d61f-44f0-b229-29c35d1a5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:12 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Volume 2ec505b0-e845-4780-919b-6eaa318b2eaa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ec505b0-e845-4780-919b-6eaa318b2eaa', 'volume_size': 1, 'snapshot_id': '1faa9637-4ef3-4c6f-a838-745a14047abf'} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf-2ec505b0-e845-4780-919b-6eaa318b2eaa" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf-2ec505b0-e845-4780-919b-6eaa318b2eaa" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Creating volume 2ec505b0-e845-4780-919b-6eaa318b2eaa from snapshot 1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] snapshot: 1faa9637-4ef3-4c6f-a838-745a14047abf, volume: 2ec505b0-e845-4780-919b-6eaa318b2eaa, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9cd91a-408f-45fb-8774-1de97559696f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:12 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:12 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:12 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.512s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727643cb-d995-4d20-aab8-a3596f1cee25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5d315-a92d-4bec-ad86-11c1b541e8e2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:12 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:12 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:13 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.450s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:28:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:28:13 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:28:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:13 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa Nov 03 17:28:13 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:21 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa" returned: 0 in 8.523s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:28:21 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Converted 1024.00 MB image at 120.11 MB/s Nov 03 17:28:21 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa is being set with open permissions: ugo+rw Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:21 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa Nov 03 17:28:21 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:21 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa" returned: 0 in 0.316s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" released by "_copy_volume_from_snapshot" :: held 9.894s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:21 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=61,cinder:UPDATE=87,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf-2ec505b0-e845-4780-919b-6eaa318b2eaa" released by "_create_volume_from_snapshot" :: held 9.978s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.996s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0feafcf-d61f-44f0-b229-29c35d1a5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec505b0-e845-4780-919b-6eaa318b2eaa', 'volume_size': 1, 'snapshot_id': '1faa9637-4ef3-4c6f-a838-745a14047abf'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2555f131-8516-459c-80d3-8a6a3ec1c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:22 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Volume volume-2ec505b0-e845-4780-919b-6eaa318b2eaa (2ec505b0-e845-4780-919b-6eaa318b2eaa): created successfully Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2555f131-8516-459c-80d3-8a6a3ec1c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Flow 'volume_create_manager' (feb749c6-4f3a-4c85-81a2-433b27bac789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-69f08a46-92cc-4e91-90b5-5c8f7613b22f tempest-VolumesDeleteCascade-866434886 None] Created volume successfully. Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-727643cb-d995-4d20-aab8-a3596f1cee25-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-727643cb-d995-4d20-aab8-a3596f1cee25-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Performing cascade delete. {{(pid=86995) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-1faa9637-4ef3-4c6f-a838-745a14047abf-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-1faa9637-4ef3-4c6f-a838-745a14047abf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Deleting offline snapshot 1faa9637-4ef3-4c6f-a838-745a14047abf of volume 727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] snapshot_file for this snap is: volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c806d-9c9d-4ddb-8601-b2c6aeebbb9d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:23 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:23 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:24 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.469s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727643cb-d995-4d20-aab8-a3596f1cee25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:28:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1f6a6-dcba-4304-b2f8-843a24539868]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:24 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:24 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:25 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.945s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:25 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:25 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:25 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.568s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:25 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf Nov 03 17:28:25 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:26 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25.1faa9637-4ef3-4c6f-a838-745a14047abf" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-1faa9637-4ef3-4c6f-a838-745a14047abf" released by "_delete_snapshot" :: held 2.530s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" released by "delete_snapshot" :: held 2.558s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Created reservations ['cc25b26c-2a1f-414a-b4e9-c8f1f933b206', '4eda0ccb-a363-4eee-8bb7-1684df62ca57', 'd040f362-f6a1-4b7a-97c7-cfd667b03a25', 'b0c47fbd-0ad7-48db-8f14-5e934439089e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Delete snapshot completed successfully. Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-1faa9637-4ef3-4c6f-a838-745a14047abf-delete_snapshot" released by "delete_snapshot" :: held 2.799s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Snapshots deleted, issuing volume delete {{(pid=86995) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a7acd6-cbd0-4001-adf4-7bc6faff5514]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:26 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:26 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:26 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.523s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:26 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25 Nov 03 17:28:26 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:27 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-727643cb-d995-4d20-aab8-a3596f1cee25" returned: 0 in 0.309s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-727643cb-d995-4d20-aab8-a3596f1cee25" released by "delete_volume" :: held 0.953s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Created reservations ['5de88e7f-d8bc-4318-aea0-fab324d812e4', '71fb494a-eb01-4aa5-a963-a1edb6604699', 'c0c09970-39c3-46d9-a5f1-da8ff5e90d22', '111bf16b-e9bc-4ed6-82cb-ad98b767bac4'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:27 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:27 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:27 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.368s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Deleted volume successfully. Nov 03 17:28:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-852d2753-53fd-4b03-8f46-bf7844d6d615 tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-727643cb-d995-4d20-aab8-a3596f1cee25-delete_volume" released by "delete_volume" :: held 4.613s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (91db080a-164f-411a-9a16-79eeb5a4b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cd65a1-2390-4a96-908d-dc70a8496277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cd65a1-2390-4a96-908d-dc70a8496277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1205991226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a0f091-312c-4b9d-a234-864f88f41100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:28Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1a695e6-1461-4a3e-855f-4db8b2697b9b),volume_type_id=f1a695e6-1461-4a3e-855f-4db8b2697b9b)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee06f1c1-d42e-48b0-9f53-59060e811d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee06f1c1-d42e-48b0-9f53-59060e811d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174d180a-40e5-4768-b28e-467e77b5740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174d180a-40e5-4768-b28e-467e77b5740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a0f091-312c-4b9d-a234-864f88f41100', 'volume_name': 'volume-b0a0f091-312c-4b9d-a234-864f88f41100', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3051e8-be8b-4567-a7f0-eca309d307ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3051e8-be8b-4567-a7f0-eca309d307ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa33e301-31fb-40d5-a783-68f5dfd059fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume b0a0f091-312c-4b9d-a234-864f88f41100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a0f091-312c-4b9d-a234-864f88f41100', 'volume_size': 1} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1205991226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a0f091-312c-4b9d-a234-864f88f41100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:28Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1a695e6-1461-4a3e-855f-4db8b2697b9b),volume_type_id=f1a695e6-1461-4a3e-855f-4db8b2697b9b)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Creating volume b0a0f091-312c-4b9d-a234-864f88f41100 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:28 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:28 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 1073741824 Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-2ec505b0-e845-4780-919b-6eaa318b2eaa-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:28 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-2ec505b0-e845-4780-919b-6eaa318b2eaa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c777c8f-7984-4c5a-8184-195e6cb8d313]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:28 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa Nov 03 17:28:28 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (c9be277c-b81b-4b03-812a-39d190178c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c8ef8a-853b-47f8-b606-a2c9acdcb3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c8ef8a-853b-47f8-b606-a2c9acdcb3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199177845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34351d6a-617e-4f94-8a62-d4efbc1a5c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:29Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8a701d-3697-4ade-bb31-6e39c7619e38),volume_type_id=5d8a701d-3697-4ade-bb31-6e39c7619e38)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57992fd-ddf8-4588-a173-a67482db7d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57992fd-ddf8-4588-a173-a67482db7d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f631d89-3461-477a-b40e-8f5b5ee539fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f631d89-3461-477a-b40e-8f5b5ee539fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34351d6a-617e-4f94-8a62-d4efbc1a5c5a', 'volume_name': 'volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5394be-163d-49ba-8c03-2e3c6fe704b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5394be-163d-49ba-8c03-2e3c6fe704b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5830aa9-7c61-4b23-9417-b42036c3f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume 34351d6a-617e-4f94-8a62-d4efbc1a5c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a', 'volume_size': 1} Nov 03 17:28:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:29 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 1073741824" returned: 0 in 0.964s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:29 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa" returned: 0 in 0.814s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:29 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 Nov 03 17:28:29 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa Nov 03 17:28:29 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:29 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:29 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ec505b0-e845-4780-919b-6eaa318b2eaa" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-quobyte-2ec505b0-e845-4780-919b-6eaa318b2eaa" released by "delete_volume" :: held 1.211s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Created reservations ['e2b00c47-1f09-4e68-ba73-11ef22bcc064', '187470f7-be21-4ec3-bbdf-79957820780d', '1c6aa62d-3dc3-4d79-a67a-d0699e32976d', '343683a3-327a-426a-ad75-0bdc10a9e49e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:29 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100" returned: 0 in 0.494s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199177845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34351d6a-617e-4f94-8a62-d4efbc1a5c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:29Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8a701d-3697-4ade-bb31-6e39c7619e38),volume_type_id=5d8a701d-3697-4ade-bb31-6e39c7619e38)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Creating volume 34351d6a-617e-4f94-8a62-d4efbc1a5c5a {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:29 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:29 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a 1073741824 Nov 03 17:28:29 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa33e301-31fb-40d5-a783-68f5dfd059fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a0f091-312c-4b9d-a234-864f88f41100', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571353d2-6990-4f61-9290-f1c6251e0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume volume-b0a0f091-312c-4b9d-a234-864f88f41100 (b0a0f091-312c-4b9d-a234-864f88f41100): created successfully Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571353d2-6990-4f61-9290-f1c6251e0225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (91db080a-164f-411a-9a16-79eeb5a4b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (7d77b257-7c48-4d6c-a620-1b67a4276cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd3e8d0-898f-44f8-bc28-e5f421231c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd3e8d0-898f-44f8-bc28-e5f421231c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-635093346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2f9090-c269-4e10-9ace-cbb5fba73e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:30Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6f935c9-a24a-4727-b210-4b8eef434bd8),volume_type_id=c6f935c9-a24a-4727-b210-4b8eef434bd8)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282e1751-9c9c-4f5d-a81d-01a8d00a81ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:30 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:30 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282e1751-9c9c-4f5d-a81d-01a8d00a81ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6fa5c4-a0ad-437c-8749-b07f4e487dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:28:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9047108b-344b-4ccd-aa3a-4539aec1e6d9 tempest-TestInstancesWithCinderVolumes-108562766 None] Created volume successfully. Nov 03 17:28:30 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.524s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Deleted volume successfully. Nov 03 17:28:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5f1e7fb2-c3be-4bcb-948b-e248b963aefe tempest-VolumesDeleteCascade-866434886 None] Lock "cinder-2ec505b0-e845-4780-919b-6eaa318b2eaa-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:31 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a 1073741824" returned: 0 in 1.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6fa5c4-a0ad-437c-8749-b07f4e487dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b2f9090-c269-4e10-9ace-cbb5fba73e2e', 'volume_name': 'volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e', 'volume_size': 1, 'image_id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1254314730', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5954b77b35c64f8da7714538ed5c4e22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'created_at': datetime.datetime(2026, 11, 3, 16, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4902b9ef-f56a-4e39-bd32-544b8d1719ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4902b9ef-f56a-4e39-bd32-544b8d1719ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99842957-a7ff-4cee-89eb-9a4ac9c041d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e', 'volume_size': 1, 'image_id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1254314730', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5954b77b35c64f8da7714538ed5c4e22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'created_at': datetime.datetime(2026, 11, 3, 16, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba/file', 'properties': {}}, 'image_service': } Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Trying to clone 7b2f9090-c269-4e10-9ace-cbb5fba73e2e from image 21f551a7-cab0-43ad-b9a1-1e7d41795aba at location (None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:31 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a Nov 03 17:28:31 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:31 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" returned: 0 in 0.542s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5830aa9-7c61-4b23-9417-b42036c3f11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8996fe63-9cf2-47e6-a25d-c6115d8bd2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a (34351d6a-617e-4f94-8a62-d4efbc1a5c5a): created successfully Nov 03 17:28:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8996fe63-9cf2-47e6-a25d-c6115d8bd2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (c9be277c-b81b-4b03-812a-39d190178c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ab4e832a-82ce-4acf-83ea-504d42d1c967 tempest-TestInstancesWithCinderVolumes-108562766 None] Created volume successfully. Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (c5058516-e544-4b3c-99ff-69512d2ae197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98db780-b265-46f6-b6c8-51b30b6bce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98db780-b265-46f6-b6c8-51b30b6bce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-142027035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b52017-3130-4555-b5a4-74cdc48963a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:34Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74921889-4e64-4924-8533-211a61696be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74921889-4e64-4924-8533-211a61696be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fed64bb-72d5-4687-86ae-bbe2e35d0d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fed64bb-72d5-4687-86ae-bbe2e35d0d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b52017-3130-4555-b5a4-74cdc48963a8', 'volume_name': 'volume-27b52017-3130-4555-b5a4-74cdc48963a8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf4980-6a1f-421c-834a-bc2de3c7a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf4980-6a1f-421c-834a-bc2de3c7a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44a564c-56e3-485b-9dcf-b57a508f8094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:33 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Volume 27b52017-3130-4555-b5a4-74cdc48963a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b52017-3130-4555-b5a4-74cdc48963a8', 'volume_size': 1} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-142027035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b52017-3130-4555-b5a4-74cdc48963a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:34Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Creating volume 27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:33 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:33 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 1073741824 Nov 03 17:28:33 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:34 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 1073741824" returned: 0 in 0.885s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:34 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 Nov 03 17:28:34 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:35 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8" returned: 0 in 0.623s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44a564c-56e3-485b-9dcf-b57a508f8094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b52017-3130-4555-b5a4-74cdc48963a8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37829076-800c-4526-bda0-5547b6c41c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:35 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Volume volume-27b52017-3130-4555-b5a4-74cdc48963a8 (27b52017-3130-4555-b5a4-74cdc48963a8): created successfully Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37829076-800c-4526-bda0-5547b6c41c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (c5058516-e544-4b3c-99ff-69512d2ae197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b0ed2881-d2d8-4255-95ff-cdfd91896720 tempest-VolumesSnapshotTestJSON-443320749 None] Created volume successfully. Nov 03 17:28:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Creating offline snapshot 0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 of volume 27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:28:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58405ff-5dbf-4878-a3b8-20faf321cd3f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:36 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 Nov 03 17:28:36 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:37 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8" returned: 0 in 0.541s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:37 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 1G Nov 03 17:28:37 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:37 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD, size 20.69 MB, duration 6.06 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:28:37 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Image download 20.69 MB at 3.42 MB/s Nov 03 17:28:37 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe9bedc-61fc-4f7b-a769-c3816b546157]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:37 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD Nov 03 17:28:37 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:38 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 1G" returned: 0 in 0.713s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b52017-3130-4555-b5a4-74cdc48963a8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:38 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Temporary image 21f551a7-cab0-43ad-b9a1-1e7d41795aba is fetched for user cb261e803f8f4a80a23d754288aba59a. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:28:38 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b52017-3130-4555-b5a4-74cdc48963a8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 Nov 03 17:28:38 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[588bf1fc-b3a0-4074-84f6-2c281d2fd72c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:38 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD Nov 03 17:28:38 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:38 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b52017-3130-4555-b5a4-74cdc48963a8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" returned: 0 in 0.458s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:38 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 is being set with open permissions: ugo+rw Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:38 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 Nov 03 17:28:38 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:38 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:38 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:38 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:38 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:38 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info Nov 03 17:28:38 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:39 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:28:39 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:39 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info is being set with open permissions: ugo+rw Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:39 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info Nov 03 17:28:39 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:39 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=117,cinder:SELECT=111,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.info" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-635093346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2f9090-c269-4e10-9ace-cbb5fba73e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5954b77b35c64f8da7714538ed5c4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:30Z,use_quota=True,user_id='cb261e803f8f4a80a23d754288aba59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6f935c9-a24a-4727-b210-4b8eef434bd8),volume_type_id=c6f935c9-a24a-4727-b210-4b8eef434bd8)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Creating volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:39 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:39 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1073741824 Nov 03 17:28:39 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Flow 'volume_create_manager' (20dceaf7-dc4d-4c80-bd1e-b14fd6668953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9317f7e-5dae-4ac0-85dd-2e9d7bcf675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9317f7e-5dae-4ac0-85dd-2e9d7bcf675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080173159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb397ee-c61e-4e0a-a459-521c9d5b8082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f3e931f0eb49f085441a7cac005dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:40Z,use_quota=True,user_id='ecfa2b48c5ca4e55b3cf69dfbcfadafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e901b996-9f4d-4924-b080-7f9babec8a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e901b996-9f4d-4924-b080-7f9babec8a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c49d8-5c41-4a9a-810c-5830bc721c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c49d8-5c41-4a9a-810c-5830bc721c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb397ee-c61e-4e0a-a459-521c9d5b8082', 'volume_name': 'volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533dd44c-e093-4895-a031-3c6fe52abf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533dd44c-e093-4895-a031-3c6fe52abf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18731ac1-a107-49da-a98a-9ededbe62393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:39 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Volume 8eb397ee-c61e-4e0a-a459-521c9d5b8082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082', 'volume_size': 1} Nov 03 17:28:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-44f9483a-9e5d-4095-9d2d-89910570f22c tempest-VolumesSnapshotTestJSON-443320749 None] Create snapshot completed successfully Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:40 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1073741824" returned: 0 in 0.553s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Deleting offline snapshot 0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 of volume 27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] snapshot_file for this snap is: volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6306b1c9-96a7-4233-8235-cb0c9032070c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:40 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e Nov 03 17:28:40 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:40 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 Nov 03 17:28:40 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:40 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080173159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb397ee-c61e-4e0a-a459-521c9d5b8082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f3e931f0eb49f085441a7cac005dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:40Z,use_quota=True,user_id='ecfa2b48c5ca4e55b3cf69dfbcfadafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Creating volume 8eb397ee-c61e-4e0a-a459-521c9d5b8082 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:40 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:40 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 1073741824 Nov 03 17:28:40 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Attempting download of 21f551a7-cab0-43ad-b9a1-1e7d41795aba ((None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}])) to volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:28:40 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" returned: 0 in 0.429s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b52017-3130-4555-b5a4-74cdc48963a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98eb033-eb8c-4ceb-83a6-e05f92374098]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[63321825-bf80-4b19-acf0-2f8ee2456040]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:40 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 Nov 03 17:28:40 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:40 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2 Nov 03 17:28:40 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 1073741824" returned: 0 in 0.565s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8" returned: 0 in 0.494s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 Nov 03 17:28:41 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 Nov 03 17:28:41 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2 Nov 03 17:28:41 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2" returned: 1 in 0.363s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21f551a7-cab0-43ad-b9a1-1e7d41795aba_fexv6bj2' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f7bc76-9eac-4cd8-9b75-898a0c47c62a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082" returned: 0 in 0.337s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18731ac1-a107-49da-a98a-9ededbe62393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:41 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbcbba2-4be5-4bc5-a3a0-4c06a1b07e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" returned: 0 in 0.416s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Volume volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 (8eb397ee-c61e-4e0a-a459-521c9d5b8082): created successfully Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbcbba2-4be5-4bc5-a3a0-4c06a1b07e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:41 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270 Nov 03 17:28:41 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Flow 'volume_create_manager' (20dceaf7-dc4d-4c80-bd1e-b14fd6668953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:41 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD Nov 03 17:28:41 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1f0fbea-ca04-4f70-9af9-09f5614f72cd tempest-VolumesTransfersTest-2008187293 None] Created volume successfully. Nov 03 17:28:41 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8.0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" returned: 0 in 0.281s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] 21f551a7-cab0-43ad-b9a1-1e7d41795aba was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270" released by "_delete_snapshot" :: held 1.768s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" released by "delete_snapshot" :: held 1.811s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:41 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e Nov 03 17:28:41 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:42 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['d1120982-2701-47d9-93a5-6614a775296a', '5c49dc8a-dcd9-4aa9-a5f3-344c8d137dcd', '1ee30340-bee9-4276-8ee1-76fdf0a02c8d', 'eb0130ed-59a6-4716-b471-c0618165321e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Delete snapshot completed successfully. Nov 03 17:28:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-00f9062f-e015-4c20-8a6e-9bc17ed09a20 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-0ccb1226-e8ec-4f2e-b1cd-50c7b6d8d270-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (84601f24-a315-4a03-9491-2883f968e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde7f616-83fc-475e-b810-342fc9921703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde7f616-83fc-475e-b810-342fc9921703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-397043309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff27150-4487-4bbd-af76-c59dcb849d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:43Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71aea64-b44a-4d63-b514-e85a83f47ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71aea64-b44a-4d63-b514-e85a83f47ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937648fc-8345-4912-9cfe-cb56ab056093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937648fc-8345-4912-9cfe-cb56ab056093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff27150-4487-4bbd-af76-c59dcb849d1b', 'volume_name': 'volume-2ff27150-4487-4bbd-af76-c59dcb849d1b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a0eaeb-13ff-49c2-b524-102f025363a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a0eaeb-13ff-49c2-b524-102f025363a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988a5262-fd17-4221-9552-418e3326d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:43 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Volume 2ff27150-4487-4bbd-af76-c59dcb849d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff27150-4487-4bbd-af76-c59dcb849d1b', 'volume_size': 1} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-397043309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff27150-4487-4bbd-af76-c59dcb849d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:43Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Creating volume 2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:43 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:43 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b 1073741824 Nov 03 17:28:43 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fe5dba7c-c6f3-4757-bf9e-366fb161e4f6 tempest-VolumesTransfersTest-1608482395 None] Transfer volume completed successfully. Nov 03 17:28:44 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b 1073741824" returned: 0 in 0.630s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:44 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:28:44 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:44 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" returned: 0 in 2.569s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21f551a7-cab0-43ad-b9a1-1e7d41795aba_ufjtlqthdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:28:44 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Converted 112.00 MB image at 43.58 MB/s Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:44 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1G Nov 03 17:28:44 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:44 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Acquiring lock "cinder-8eb397ee-c61e-4e0a-a459-521c9d5b8082-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 0.482s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "cinder-8eb397ee-c61e-4e0a-a459-521c9d5b8082-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988a5262-fd17-4221-9552-418e3326d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff27150-4487-4bbd-af76-c59dcb849d1b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515aab2b-95ba-42eb-95d1-f44ad48d2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Volume volume-2ff27150-4487-4bbd-af76-c59dcb849d1b (2ff27150-4487-4bbd-af76-c59dcb849d1b): created successfully Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515aab2b-95ba-42eb-95d1-f44ad48d2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (84601f24-a315-4a03-9491-2883f968e953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d6ad9d8d-232a-4679-bd75-5f36f5e3d9bd tempest-VolumesSnapshotTestJSON-443320749 None] Created volume successfully. Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Acquiring lock "cinder-quobyte-8eb397ee-c61e-4e0a-a459-521c9d5b8082" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "cinder-quobyte-8eb397ee-c61e-4e0a-a459-521c9d5b8082" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f9eff-a752-4492-96f5-5ea494dd2f51]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:45 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 Nov 03 17:28:45 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:45 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e 1G" returned: 0 in 0.575s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Downloaded image 21f551a7-cab0-43ad-b9a1-1e7d41795aba ((None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}])) to volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Temporary image 21f551a7-cab0-43ad-b9a1-1e7d41795aba for user cb261e803f8f4a80a23d754288aba59a is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Marking volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Copying metadata from image 21f551a7-cab0-43ad-b9a1-1e7d41795aba to 7b2f9090-c269-4e10-9ace-cbb5fba73e2e. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Creating volume glance metadata for volume 7b2f9090-c269-4e10-9ace-cbb5fba73e2e backed by image 21f551a7-cab0-43ad-b9a1-1e7d41795aba with: {'image_id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'image_name': 'tempest-scenario-img--1254314730', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99842957-a7ff-4cee-89eb-9a4ac9c041d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e', 'volume_size': 1, 'image_id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1254314730', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5954b77b35c64f8da7714538ed5c4e22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21f551a7-cab0-43ad-b9a1-1e7d41795aba', 'created_at': datetime.datetime(2026, 11, 3, 16, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21f551a7-cab0-43ad-b9a1-1e7d41795aba/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbfdd1c-9b38-4f72-a3c3-7e4172e1e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Volume volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e (7b2f9090-c269-4e10-9ace-cbb5fba73e2e): created successfully Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbfdd1c-9b38-4f72-a3c3-7e4172e1e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Flow 'volume_create_manager' (7d77b257-7c48-4d6c-a620-1b67a4276cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0650bba4-b597-47d7-bbe4-f1f189774645 tempest-TestInstancesWithCinderVolumes-108562766 None] Created volume successfully. Nov 03 17:28:45 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082" returned: 0 in 0.496s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:45 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082 Nov 03 17:28:45 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Creating offline snapshot ffd71209-4a2d-4593-a5f3-4247e282028f of volume 2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[897fd828-fdee-4f9b-b8a6-72ee41628362]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:45 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8eb397ee-c61e-4e0a-a459-521c9d5b8082" returned: 0 in 0.322s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "cinder-quobyte-8eb397ee-c61e-4e0a-a459-521c9d5b8082" released by "delete_volume" :: held 0.916s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:45 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:28:45 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Created reservations ['659b64d0-8b15-446b-a2a9-95a7082b6d90', '479d59db-b5d6-4860-bfc5-89a0bf7d8235', 'f2f48d55-0513-4b63-a82a-8a17756bd2fa', '3d28e213-48ad-4702-8461-0d7806539210'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:45 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:45 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:46 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:46 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f 1G Nov 03 17:28:46 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:46 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Deleted volume successfully. Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-055a85e8-fd8c-41aa-bf71-7bd638d6e4bb tempest-VolumesTransfersTest-567232272 None] Lock "cinder-8eb397ee-c61e-4e0a-a459-521c9d5b8082-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:46 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f 1G" returned: 0 in 0.464s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff27150-4487-4bbd-af76-c59dcb849d1b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:46 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff27150-4487-4bbd-af76-c59dcb849d1b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:28:46 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:46 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff27150-4487-4bbd-af76-c59dcb849d1b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:46 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f is being set with open permissions: ugo+rw Nov 03 17:28:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:46 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:28:46 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:47 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.290s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:47 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info Nov 03 17:28:47 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:47 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Flow 'volume_create_manager' (07113504-8bb8-438c-8785-a454fd692ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb37c57b-9579-4c08-a0a3-09f3f4642cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info" returned: 0 in 0.368s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:47 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info is being set with open permissions: ugo+rw Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:47 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb37c57b-9579-4c08-a0a3-09f3f4642cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522166290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55df54b-d905-4dbc-9401-03ca6289f195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f3e931f0eb49f085441a7cac005dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:48Z,use_quota=True,user_id='ecfa2b48c5ca4e55b3cf69dfbcfadafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:47 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee29785-9204-4dda-88c1-79c71e028562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee29785-9204-4dda-88c1-79c71e028562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f87730-4b7f-4d89-9535-ac9aa0f1768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f87730-4b7f-4d89-9535-ac9aa0f1768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55df54b-d905-4dbc-9401-03ca6289f195', 'volume_name': 'volume-b55df54b-d905-4dbc-9401-03ca6289f195', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c729176f-3fc1-4fef-a7a3-b01003904539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c729176f-3fc1-4fef-a7a3-b01003904539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef01e62-717c-45f6-b33e-0e825d1c091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Volume b55df54b-d905-4dbc-9401-03ca6289f195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55df54b-d905-4dbc-9401-03ca6289f195', 'volume_size': 1} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:47 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.info" returned: 0 in 0.334s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522166290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55df54b-d905-4dbc-9401-03ca6289f195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f3e931f0eb49f085441a7cac005dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:48Z,use_quota=True,user_id='ecfa2b48c5ca4e55b3cf69dfbcfadafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Creating volume b55df54b-d905-4dbc-9401-03ca6289f195 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:48 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:48 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 1073741824 Nov 03 17:28:48 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-518548a6-4364-421b-b085-b2e32963ab23 tempest-VolumesSnapshotTestJSON-443320749 None] Create snapshot completed successfully Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-766b60a2-e997-4801-be6c-a7e294c1a307 req-419ad2d3-a046-4a59-b22d-c749b066d77b tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:48 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 1073741824" returned: 0 in 0.486s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:48 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 Nov 03 17:28:48 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:48 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195" returned: 0 in 0.324s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-766b60a2-e997-4801-be6c-a7e294c1a307 req-419ad2d3-a046-4a59-b22d-c749b066d77b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.580s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef01e62-717c-45f6-b33e-0e825d1c091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55df54b-d905-4dbc-9401-03ca6289f195', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fda176-30eb-4523-ad00-825e51376b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-766b60a2-e997-4801-be6c-a7e294c1a307 req-419ad2d3-a046-4a59-b22d-c749b066d77b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Volume volume-b55df54b-d905-4dbc-9401-03ca6289f195 (b55df54b-d905-4dbc-9401-03ca6289f195): created successfully Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fda176-30eb-4523-ad00-825e51376b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Flow 'volume_create_manager' (07113504-8bb8-438c-8785-a454fd692ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bcf137ed-bafc-4a76-845b-6b8a80b2d8b6 tempest-VolumesTransfersTest-2008187293 None] Created volume successfully. Nov 03 17:28:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-766b60a2-e997-4801-be6c-a7e294c1a307 req-419ad2d3-a046-4a59-b22d-c749b066d77b tempest-TestInstancesWithCinderVolumes-108562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31c3c26d-5571-49fd-9354-2108cc4300df', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:28:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-766b60a2-e997-4801-be6c-a7e294c1a307 req-419ad2d3-a046-4a59-b22d-c749b066d77b tempest-TestInstancesWithCinderVolumes-108562766 None] attachment_update completed successfully. Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (0e6f6ce5-5025-4d52-9b28-9325cb4f12cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a86cec6-efb5-48a0-b400-87caa815489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a86cec6-efb5-48a0-b400-87caa815489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471674910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29535a07-5f08-4e92-9296-f5bbcd66e8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ffd71209-4a2d-4593-a5f3-4247e282028f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:49Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05636148-e5a9-4aaf-80ba-a092fea1ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05636148-e5a9-4aaf-80ba-a092fea1ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd15ab-9bb5-49b5-b91b-048e4a944a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd15ab-9bb5-49b5-b91b-048e4a944a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29535a07-5f08-4e92-9296-f5bbcd66e8b4', 'volume_name': 'volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4', 'volume_size': 2, 'snapshot_id': 'ffd71209-4a2d-4593-a5f3-4247e282028f'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8569fd-161b-4bab-af9a-9996af15e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8569fd-161b-4bab-af9a-9996af15e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd3563-c307-4a25-96cd-0bd6693fcf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:49 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Volume 29535a07-5f08-4e92-9296-f5bbcd66e8b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4', 'volume_size': 2, 'snapshot_id': 'ffd71209-4a2d-4593-a5f3-4247e282028f'} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f-29535a07-5f08-4e92-9296-f5bbcd66e8b4" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f-29535a07-5f08-4e92-9296-f5bbcd66e8b4" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Creating volume 29535a07-5f08-4e92-9296-f5bbcd66e8b4 from snapshot ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] snapshot: ffd71209-4a2d-4593-a5f3-4247e282028f, volume: 29535a07-5f08-4e92-9296-f5bbcd66e8b4, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[60778775-cae0-42ca-9158-8648e8846e78]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:49 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:28:49 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:50 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.360s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff27150-4487-4bbd-af76-c59dcb849d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f20a38-5af4-4d3d-acef-d9e75dda4271]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:50 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:28:50 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Acquiring lock "cinder-b55df54b-d905-4dbc-9401-03ca6289f195-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "cinder-b55df54b-d905-4dbc-9401-03ca6289f195-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Acquiring lock "cinder-quobyte-b55df54b-d905-4dbc-9401-03ca6289f195" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "cinder-quobyte-b55df54b-d905-4dbc-9401-03ca6289f195" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1016259e-1e84-45e1-8faa-593d88e250eb]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:50 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 0.504s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:50 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 Nov 03 17:28:50 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:50 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 Nov 03 17:28:50 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:50 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195" returned: 0 in 0.407s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:50 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195 Nov 03 17:28:50 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:51 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b55df54b-d905-4dbc-9401-03ca6289f195" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "cinder-quobyte-b55df54b-d905-4dbc-9401-03ca6289f195" released by "delete_volume" :: held 0.822s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Created reservations ['5b25952d-5ca3-4b9a-b000-9992b53995f2', '22e22908-0d8c-4e38-ae58-561720fbb896', '92fe0e69-e07e-4b51-b091-f71a8be45d7d', 'df1bafb1-e792-46ca-a8c6-71410ac8db30'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:28:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:28:51 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:28:51 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:28:52 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 03 17:28:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.868s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:28:52 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:28:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Deleted volume successfully. Nov 03 17:28:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b9ae1296-5fa6-40a8-a0cb-f8bdc7659de7 tempest-VolumesTransfersTest-567232272 None] Lock "cinder-b55df54b-d905-4dbc-9401-03ca6289f195-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (0854735d-cf0f-470b-9ce9-76d3e90d8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbf2436-b47d-4248-aa92-ab0167379b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbf2436-b47d-4248-aa92-ab0167379b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1618458689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e675738-078b-4181-87bd-47983597bfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:58Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95749b69-fe33-4ad3-a565-99699c537c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95749b69-fe33-4ad3-a565-99699c537c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058353de-4980-4fae-86ac-dca2bcb4d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058353de-4980-4fae-86ac-dca2bcb4d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e675738-078b-4181-87bd-47983597bfda', 'volume_name': 'volume-4e675738-078b-4181-87bd-47983597bfda', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482c57ae-f1e4-4287-8783-2572b6134c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482c57ae-f1e4-4287-8783-2572b6134c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e72fee1-0622-4339-8d7c-1ca3775b92ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:28:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Volume 4e675738-078b-4181-87bd-47983597bfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e675738-078b-4181-87bd-47983597bfda', 'volume_size': 1} Nov 03 17:28:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:02 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4" returned: 0 in 11.957s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:02 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b, size 1024.00 MB, duration 11.96 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:29:02 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Converted 1024.00 MB image at 85.64 MB/s Nov 03 17:29:02 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 is being set with open permissions: ugo+rw Nov 03 17:29:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:02 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 Nov 03 17:29:02 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:02 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" released by "_copy_volume_from_snapshot" :: held 13.331s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f-29535a07-5f08-4e92-9296-f5bbcd66e8b4" released by "_create_volume_from_snapshot" :: held 13.431s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.455s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.185s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1618458689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e675738-078b-4181-87bd-47983597bfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3d398792544729a6bf2e4b1296ae13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:28:58Z,use_quota=True,user_id='0f35878ad2e843208f0af90604197c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Creating volume 4e675738-078b-4181-87bd-47983597bfda {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:03 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd3563-c307-4a25-96cd-0bd6693fcf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4', 'volume_size': 2, 'snapshot_id': 'ffd71209-4a2d-4593-a5f3-4247e282028f'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc47572-b3c4-4b67-b637-f24aa293ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:03 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda 1073741824 Nov 03 17:29:03 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:03 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Volume volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 (29535a07-5f08-4e92-9296-f5bbcd66e8b4): created successfully Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc47572-b3c4-4b67-b637-f24aa293ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (0e6f6ce5-5025-4d52-9b28-9325cb4f12cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cf16ed5d-4840-49ca-aae5-67230a141374 tempest-VolumesSnapshotTestJSON-443320749 None] Created volume successfully. Nov 03 17:29:03 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda 1073741824" returned: 0 in 0.704s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:03 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda Nov 03 17:29:03 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-29535a07-5f08-4e92-9296-f5bbcd66e8b4-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-29535a07-5f08-4e92-9296-f5bbcd66e8b4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e54cb-f7e6-4936-a548-16f4c0a151bf]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:04 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda" returned: 0 in 0.753s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e72fee1-0622-4339-8d7c-1ca3775b92ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e675738-078b-4181-87bd-47983597bfda', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cdc4f4-ddb4-4466-81fb-623647f7befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:04 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Volume volume-4e675738-078b-4181-87bd-47983597bfda (4e675738-078b-4181-87bd-47983597bfda): created successfully Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cdc4f4-ddb4-4466-81fb-623647f7befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Flow 'volume_create_manager' (0854735d-cf0f-470b-9ce9-76d3e90d8b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fbc6eba2-3118-4fac-93a3-b06ae38f30a3 tempest-AttachVolumeNegativeTest-1927615303 None] Created volume successfully. Nov 03 17:29:04 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 Nov 03 17:29:04 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:05 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4" returned: 0 in 0.730s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:05 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4 Nov 03 17:29:05 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:05 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29535a07-5f08-4e92-9296-f5bbcd66e8b4" returned: 0 in 0.528s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:05 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-29535a07-5f08-4e92-9296-f5bbcd66e8b4" released by "delete_volume" :: held 1.350s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:05 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['429b006b-431d-4572-bc22-090d338f9b39', '92f62e51-b2d6-49de-a7f9-731cf4cdfeb9', '89a4408b-eb35-49de-a034-ab61f19c6e05', '9502ea13-2b38-458a-8e64-95347e106c82'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:06 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:06 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:06 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Deleted volume successfully. Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d6012d3-a65f-4c01-8126-24080dd636ed tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-29535a07-5f08-4e92-9296-f5bbcd66e8b4-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-ffd71209-4a2d-4593-a5f3-4247e282028f-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-ffd71209-4a2d-4593-a5f3-4247e282028f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Deleting offline snapshot ffd71209-4a2d-4593-a5f3-4247e282028f of volume 2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] snapshot_file for this snap is: volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd9de5d-c7b4-400a-bb64-62b00d67a1ec]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:07 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:29:07 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7beab08a-75d5-417d-99a8-fd9afd59cd46 req-9d7e537b-3b3e-49d9-a409-594dce121385 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7beab08a-75d5-417d-99a8-fd9afd59cd46 req-9d7e537b-3b3e-49d9-a409-594dce121385 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7beab08a-75d5-417d-99a8-fd9afd59cd46 req-9d7e537b-3b3e-49d9-a409-594dce121385 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-7beab08a-75d5-417d-99a8-fd9afd59cd46 req-9d7e537b-3b3e-49d9-a409-594dce121385 tempest-AttachVolumeNegativeTest-1927615303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-4e675738-078b-4181-87bd-47983597bfda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d0f5e16-c758-452e-8fba-c33c2554b2ae', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:29:07 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-7beab08a-75d5-417d-99a8-fd9afd59cd46 req-9d7e537b-3b3e-49d9-a409-594dce121385 tempest-AttachVolumeNegativeTest-1927615303 None] attachment_update completed successfully. Nov 03 17:29:07 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.599s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff27150-4487-4bbd-af76-c59dcb849d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625e033-4543-40ab-a900-ef5b68d26309]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:08 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:29:08 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Flow 'volume_create_manager' (c873acdb-e384-45e1-a309-b20996b0e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc961dd-2f00-4958-ae87-56a93c3ceddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc961dd-2f00-4958-ae87-56a93c3ceddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-300630249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fe7492-48e7-4413-9104-4331f05f1208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47e76f099a4e8384d9ff5644382d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:09Z,use_quota=True,user_id='f80b687d379c487482f154d4baa4f489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39f015f-03b4-4dc8-9691-76352515bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39f015f-03b4-4dc8-9691-76352515bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ef1126-7660-44e6-96cf-c7e5d3f9bdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:08 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ef1126-7660-44e6-96cf-c7e5d3f9bdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83fe7492-48e7-4413-9104-4331f05f1208', 'volume_name': 'volume-83fe7492-48e7-4413-9104-4331f05f1208', 'volume_size': 2}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce79c71-2788-4ff1-b1dd-961dfac9ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce79c71-2788-4ff1-b1dd-961dfac9ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9824a1e1-5c42-45d1-965c-2cf2d80fd7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Volume 83fe7492-48e7-4413-9104-4331f05f1208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83fe7492-48e7-4413-9104-4331f05f1208', 'volume_size': 2} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-300630249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fe7492-48e7-4413-9104-4331f05f1208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47e76f099a4e8384d9ff5644382d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:09Z,use_quota=True,user_id='f80b687d379c487482f154d4baa4f489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Creating volume 83fe7492-48e7-4413-9104-4331f05f1208 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:08 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 2147483648 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 1.064s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:08 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 2147483648 Nov 03 17:29:08 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:08 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:29:08 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:09 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.441s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:09 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f Nov 03 17:29:09 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:09 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 2147483648" returned: 0 in 0.789s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:09 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 Nov 03 17:29:09 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:09 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b.ffd71209-4a2d-4593-a5f3-4247e282028f" returned: 0 in 0.496s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-ffd71209-4a2d-4593-a5f3-4247e282028f" released by "_delete_snapshot" :: held 2.790s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" released by "delete_snapshot" :: held 2.839s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['59f44f23-0ccb-4b0d-8485-51c58f9e9502', '8c7d78a4-b4eb-4862-9224-8a11f0c93a03', '0253cd88-09f7-4956-8163-d72eed0a7f3b', '61c2dec6-8f6d-4b28-b324-c867a98c274c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Delete snapshot completed successfully. Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-52d8f635-c7b0-45b0-9abc-d0b20b3bb529 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-ffd71209-4a2d-4593-a5f3-4247e282028f-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:10 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208" returned: 0 in 0.631s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9824a1e1-5c42-45d1-965c-2cf2d80fd7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fe7492-48e7-4413-9104-4331f05f1208', 'volume_size': 2}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6228c1-79e2-4009-a2b1-444591f9540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:10 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Volume volume-83fe7492-48e7-4413-9104-4331f05f1208 (83fe7492-48e7-4413-9104-4331f05f1208): created successfully Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6228c1-79e2-4009-a2b1-444591f9540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Flow 'volume_create_manager' (c873acdb-e384-45e1-a309-b20996b0e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1de4437f-4a8d-46ff-bea4-89348b591bda tempest-VolumesCloneNegativeTest-217781745 None] Created volume successfully. Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-2ff27150-4487-4bbd-af76-c59dcb849d1b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-2ff27150-4487-4bbd-af76-c59dcb849d1b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" acquired by "delete_volume" :: waited 0.039s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e861b3db-4e78-488f-922e-5bc5ed6909b9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-0315d267-bba3-4ff0-8305-5a25b1476b68 req-bd9dccef-10bb-4cc8-9211-27e85504d00b tempest-AttachVolumeNegativeTest-1927615303 None] Terminate volume connection completed successfully. Nov 03 17:29:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-0315d267-bba3-4ff0-8305-5a25b1476b68 req-bd9dccef-10bb-4cc8-9211-27e85504d00b tempest-AttachVolumeNegativeTest-1927615303 None] Deleting attachment 7d0f5e16-c758-452e-8fba-c33c2554b2ae. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:29:10 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:29:10 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Acquiring lock "cinder-83fe7492-48e7-4413-9104-4331f05f1208-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "cinder-83fe7492-48e7-4413-9104-4331f05f1208-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Acquiring lock "cinder-quobyte-83fe7492-48e7-4413-9104-4331f05f1208" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "cinder-quobyte-83fe7492-48e7-4413-9104-4331f05f1208" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00cc09-4f15-4c61-9e74-bf80709b9f22]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:11 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 0.601s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:11 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b Nov 03 17:29:11 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:11 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 Nov 03 17:29:11 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:11 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208" returned: 0 in 0.637s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:11 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2ff27150-4487-4bbd-af76-c59dcb849d1b" returned: 0 in 0.566s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:11 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208 Nov 03 17:29:11 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-2ff27150-4487-4bbd-af76-c59dcb849d1b" released by "delete_volume" :: held 1.273s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['9d13ffa3-4e52-47a0-9b47-383512251ecd', '0d9347e0-b45f-4ed6-b1be-ef477bbccd4f', 'e1a76b7f-56d1-45f2-b4e6-7ab0892f940f', '8b010e83-eaac-4739-9be2-ada53853f1e0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:12 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:12 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:12 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-83fe7492-48e7-4413-9104-4331f05f1208" returned: 0 in 0.562s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "cinder-quobyte-83fe7492-48e7-4413-9104-4331f05f1208" released by "delete_volume" :: held 1.283s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Created reservations ['746fbe49-e682-45ee-925e-a78f3b7c044c', '31b04838-0051-4c14-9d7c-ac304972d3f8', '3253c9b4-0b4b-4430-99f8-4214be5ef5f6', '20d81c7a-804d-4962-9d2d-30bf53ab27e9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:12 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.534s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Deleted volume successfully. Nov 03 17:29:12 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:12 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6488bcc7-dbb6-47fa-be3c-fa9b9b08e30c tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-2ff27150-4487-4bbd-af76-c59dcb849d1b-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:13 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.422s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:13 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Deleted volume successfully. Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4e73d4d-59bc-49b3-aba3-f6b8373fde75 tempest-VolumesCloneNegativeTest-217781745 None] Lock "cinder-83fe7492-48e7-4413-9104-4331f05f1208-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (79eeea70-a413-4392-81af-7b4b66d2c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c98a6bd-2668-4a25-8350-8038519ca63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c98a6bd-2668-4a25-8350-8038519ca63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1579590357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f86f8b-50ee-433d-b06d-b4fbd93da6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:14Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc2a9b6-c751-4cc0-a17e-88a3ab7d613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc2a9b6-c751-4cc0-a17e-88a3ab7d613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d492c69-3657-4c02-b0e3-73983fe2a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d492c69-3657-4c02-b0e3-73983fe2a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f86f8b-50ee-433d-b06d-b4fbd93da6cb', 'volume_name': 'volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfb3502-21ab-46f1-a368-38a72c531b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfb3502-21ab-46f1-a368-38a72c531b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a1f61c-ec44-4c09-a3bd-75f3047811d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Volume c5f86f8b-50ee-433d-b06d-b4fbd93da6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb', 'volume_size': 1} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1579590357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f86f8b-50ee-433d-b06d-b4fbd93da6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:14Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Creating volume c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:14 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb 1073741824 Nov 03 17:29:14 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:14 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb 1073741824" returned: 0 in 0.653s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:14 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:14 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:15 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a1f61c-ec44-4c09-a3bd-75f3047811d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156d9d24-22fd-4264-9d31-50479b253549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Volume volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb (c5f86f8b-50ee-433d-b06d-b4fbd93da6cb): created successfully Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156d9d24-22fd-4264-9d31-50479b253549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (79eeea70-a413-4392-81af-7b4b66d2c12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2e640be0-b051-432d-8431-a28be9469880 tempest-VolumesSnapshotTestJSON-443320749 None] Created volume successfully. Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Creating offline snapshot cb93ce94-0ac1-4725-af37-cccd962e6fdf of volume c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[16899ef3-d2f7-4021-b3ce-ecb55eb42aa0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-4e675738-078b-4181-87bd-47983597bfda-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-4e675738-078b-4181-87bd-47983597bfda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:16 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:16 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-quobyte-4e675738-078b-4181-87bd-47983597bfda" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-4e675738-078b-4181-87bd-47983597bfda" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41cc74a-36e6-40c1-bfa9-e6acbbad8af7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:16 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda Nov 03 17:29:16 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:16 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.468s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:16 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf 1G Nov 03 17:29:16 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:16 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:16 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda Nov 03 17:29:16 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:17 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4e675738-078b-4181-87bd-47983597bfda" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:17 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf 1G" returned: 0 in 0.473s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-4e675738-078b-4181-87bd-47983597bfda" released by "delete_volume" :: held 0.745s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:17 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:17 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Created reservations ['49ec202d-182c-40f5-b38b-8a1289a8aded', 'e11fad0f-b740-43cd-a7d1-f62f5d4bad5c', '3fa91cba-8c73-4a0d-ba9a-720bb2d5dd48', '3678107a-cc43-4126-9615-34433dbe47c7'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:17 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:17 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:17 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.357s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:17 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf is being set with open permissions: ugo+rw Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:17 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:17 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:17 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Deleted volume successfully. Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-51d01b90-d0af-455f-80e0-9da47b0e1ba6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1d838381-f9e5-4c27-bc9f-80fe8d4cbf0c tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-4e675738-078b-4181-87bd-47983597bfda-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-51d01b90-d0af-455f-80e0-9da47b0e1ba6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-quobyte-51d01b90-d0af-455f-80e0-9da47b0e1ba6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-51d01b90-d0af-455f-80e0-9da47b0e1ba6" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8020c3-f096-426b-a4c8-6721903b5eb5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:17 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:17 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 Nov 03 17:29:17 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:18 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info Nov 03 17:29:18 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:18 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:18 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6 Nov 03 17:29:18 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:18 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info" returned: 0 in 0.327s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:18 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info is being set with open permissions: ugo+rw Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:18 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info Nov 03 17:29:18 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Flow 'volume_create_manager' (f6f5f4d0-631c-4cd8-9632-d5095b5a4b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7273a4e-b5e5-4759-bc35-f332562356a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7273a4e-b5e5-4759-bc35-f332562356a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1267400985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf4168c-1f73-436a-acce-d391af55304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a2f0dcf84d47689fa8c1e516f59b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:18Z,use_quota=True,user_id='ddb30d1dc4f64653bdf3d0990b9a6ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0e0773-4718-455c-b6a2-1c1241db5784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0e0773-4718-455c-b6a2-1c1241db5784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:18 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb104cf-75ba-4a19-9c9b-2406e5a36934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb104cf-75ba-4a19-9c9b-2406e5a36934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf4168c-1f73-436a-acce-d391af55304a', 'volume_name': 'volume-2cf4168c-1f73-436a-acce-d391af55304a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30cca05-4520-4b53-94fd-d09d0ed155c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30cca05-4520-4b53-94fd-d09d0ed155c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844aa084-60cf-41c6-89c0-1113927f0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Volume 2cf4168c-1f73-436a-acce-d391af55304a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf4168c-1f73-436a-acce-d391af55304a', 'volume_size': 1} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-51d01b90-d0af-455f-80e0-9da47b0e1ba6" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-51d01b90-d0af-455f-80e0-9da47b0e1ba6" released by "delete_volume" :: held 0.785s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:18 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.info" returned: 0 in 0.249s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.394s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1267400985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf4168c-1f73-436a-acce-d391af55304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a2f0dcf84d47689fa8c1e516f59b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:18Z,use_quota=True,user_id='ddb30d1dc4f64653bdf3d0990b9a6ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Creating volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:18 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:18 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a 1073741824 Nov 03 17:29:18 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Created reservations ['f6d0d5e5-8588-49d5-ab0e-9df7271c914e', '96cd7813-90ea-4c40-a00e-027cfcb96fdc', '048104e7-acbf-41d4-a5ad-958e7ecff653', 'e6a2e31a-06ba-4baa-9087-d053330f8d22'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-025e16ba-4d02-4ecf-87e7-152075139ba4 tempest-VolumesSnapshotTestJSON-443320749 None] Create snapshot completed successfully Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:18 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:18 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:19 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.294s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Deleted volume successfully. Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c6ec9293-c149-4be4-aa63-d83fabe3f229 tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-51d01b90-d0af-455f-80e0-9da47b0e1ba6-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-b92c6bd5-ede1-4bf9-897b-ff666923d477-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-b92c6bd5-ede1-4bf9-897b-ff666923d477-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:19 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "cinder-quobyte-b92c6bd5-ede1-4bf9-897b-ff666923d477" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a 1073741824" returned: 0 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-b92c6bd5-ede1-4bf9-897b-ff666923d477" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0b7e3-a8a8-426f-877a-100aaa30fe79]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:19 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a Nov 03 17:29:19 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:19 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 Nov 03 17:29:19 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:19 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844aa084-60cf-41c6-89c0-1113927f0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf4168c-1f73-436a-acce-d391af55304a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d632ef-8cb4-4a9e-8286-22d337145677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Volume volume-2cf4168c-1f73-436a-acce-d391af55304a (2cf4168c-1f73-436a-acce-d391af55304a): created successfully Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d632ef-8cb4-4a9e-8286-22d337145677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Flow 'volume_create_manager' (f6f5f4d0-631c-4cd8-9632-d5095b5a4b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-955acc8b-929c-460c-ba66-8d7bc2668850 tempest-VolumesSnapshotListTestJSON-1807446965 None] Created volume successfully. Nov 03 17:29:19 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477" returned: 0 in 0.402s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:19 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477 Nov 03 17:29:19 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:19 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b92c6bd5-ede1-4bf9-897b-ff666923d477" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-quobyte-b92c6bd5-ede1-4bf9-897b-ff666923d477" released by "delete_volume" :: held 0.709s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (ace3950d-8558-4a8b-bac5-1493b407e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a7c5a7-e284-4a63-a90b-f8fc78219f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a7c5a7-e284-4a63-a90b-f8fc78219f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-724578748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebf53bb-36cc-4dec-881a-3d430e6a6c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c781d707037248829469bf7638e993f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb93ce94-0ac1-4725-af37-cccd962e6fdf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:20Z,use_quota=True,user_id='3b168b9054dc4138906a6383ae133789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345909c6-b361-4d53-b863-9f7cde8f1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345909c6-b361-4d53-b863-9f7cde8f1910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a767a-3e41-433d-97c0-6ff9e9be0888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a767a-3e41-433d-97c0-6ff9e9be0888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ebf53bb-36cc-4dec-881a-3d430e6a6c43', 'volume_name': 'volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43', 'volume_size': 1, 'snapshot_id': 'cb93ce94-0ac1-4725-af37-cccd962e6fdf'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c12c74-87a7-455c-8243-c3b1ddd71fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c12c74-87a7-455c-8243-c3b1ddd71fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288a78ca-95d6-41c4-934c-919e2bf6ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Volume 3ebf53bb-36cc-4dec-881a-3d430e6a6c43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43', 'volume_size': 1, 'snapshot_id': 'cb93ce94-0ac1-4725-af37-cccd962e6fdf'} Nov 03 17:29:19 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Created reservations ['d1e054e1-6daf-4ba6-b50c-87b1551a6094', '26c88e0e-9958-48c2-9954-52be0577d023', 'ef06ba6c-49a3-487e-9f5a-cd43e1893d94', '3e4c7907-7101-471c-86f5-bc055d748782'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Creating volume 3ebf53bb-36cc-4dec-881a-3d430e6a6c43 from snapshot cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] snapshot: cb93ce94-0ac1-4725-af37-cccd962e6fdf, volume: 3ebf53bb-36cc-4dec-881a-3d430e6a6c43, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0af19d-51fc-43ed-92e6-2fe0cdd57288]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:20 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:20 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:20 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:20 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:20 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Deleted volume successfully. Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e2026359-489c-462e-b57e-438fa8957fba tempest-AttachVolumeNegativeTest-1927615303 None] Lock "cinder-b92c6bd5-ede1-4bf9-897b-ff666923d477-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:20 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.423s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f33686-0c9c-4ae2-ab9e-06809710e2d7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:20 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:20 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:20 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:29:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:20 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 Nov 03 17:29:20 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:28 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" returned: 0 in 7.337s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:29:28 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Converted 1024.00 MB image at 139.54 MB/s Nov 03 17:29:28 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 is being set with open permissions: ugo+rw Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:28 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 Nov 03 17:29:28 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:28 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" returned: 0 in 0.251s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" released by "_copy_volume_from_snapshot" :: held 8.514s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=143,cinder:DELETE=12,cinder:SELECT=126,cinder:INSERT=39 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" released by "_create_volume_from_snapshot" :: held 8.584s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.614s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.892s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Creating offline snapshot 7295513b-c79c-4d1a-9b1d-a5beb06ad00a of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288a78ca-95d6-41c4-934c-919e2bf6ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43', 'volume_size': 1, 'snapshot_id': 'cb93ce94-0ac1-4725-af37-cccd962e6fdf'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed24cf-fbab-452f-a2de-82bfb8049636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[818349f4-91ef-41d1-afe4-03209300e0fc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Volume volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 (3ebf53bb-36cc-4dec-881a-3d430e6a6c43): created successfully Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed24cf-fbab-452f-a2de-82bfb8049636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Flow 'volume_create_manager' (ace3950d-8558-4a8b-bac5-1493b407e06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7762b754-2959-4c67-afca-c59fd44c66f3 tempest-VolumesSnapshotTestJSON-443320749 None] Created volume successfully. Nov 03 17:29:28 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a Nov 03 17:29:28 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:29 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:29 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a 1G Nov 03 17:29:29 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:29 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a 1G" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:29 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:29 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-3ebf53bb-36cc-4dec-881a-3d430e6a6c43-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:29 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.327s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:29 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a is being set with open permissions: ugo+rw Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-3ebf53bb-36cc-4dec-881a-3d430e6a6c43-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:29 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:29 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b5ea0-0d09-46ab-aeb4-27a32a9d9514]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:30 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 Nov 03 17:29:30 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:30 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:30 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info Nov 03 17:29:30 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:30 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" returned: 0 in 0.425s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:30 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43 Nov 03 17:29:30 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:30 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:30 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info is being set with open permissions: ugo+rw Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:30 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info Nov 03 17:29:30 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:30 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-3ebf53bb-36cc-4dec-881a-3d430e6a6c43" released by "delete_volume" :: held 0.757s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['f47721a6-5681-445d-a472-feafbe59993a', '37d21697-e625-4ccb-9676-dc92b6f40177', '4edb3ffd-6073-4c84-a21a-da728481275a', '28ee1b13-5907-4269-9438-085a543118a0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:30 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.info" returned: 0 in 0.316s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d6f702fc-73fc-4f74-b913-83db9d8da939 tempest-VolumesSnapshotListTestJSON-1807446965 None] Create snapshot completed successfully Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:30 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:30 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-cb93ce94-0ac1-4725-af37-cccd962e6fdf-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-cb93ce94-0ac1-4725-af37-cccd962e6fdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Deleting offline snapshot cb93ce94-0ac1-4725-af37-cccd962e6fdf of volume c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] snapshot_file for this snap is: volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efbc5a2-f428-4824-8913-a1ba3c3f1190]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:31 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.372s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Deleted volume successfully. Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-896d4356-c8e8-45e2-bae8-8f42a60a5e03 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-3ebf53bb-36cc-4dec-881a-3d430e6a6c43-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:31 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:31 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-2b711cb5-cb87-4591-bd88-fa4c44744f25 req-8268316f-e45b-46d4-a8f2-c2ed82aad096 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-2b711cb5-cb87-4591-bd88-fa4c44744f25 req-8268316f-e45b-46d4-a8f2-c2ed82aad096 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-2b711cb5-cb87-4591-bd88-fa4c44744f25 req-8268316f-e45b-46d4-a8f2-c2ed82aad096 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:31 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.456s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-2b711cb5-cb87-4591-bd88-fa4c44744f25 req-8268316f-e45b-46d4-a8f2-c2ed82aad096 tempest-TestInstancesWithCinderVolumes-108562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-b0a0f091-312c-4b9d-a234-864f88f41100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17f539c9-1661-4f8c-8d6c-bfb1782adeed', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305ea1c-f610-4504-8906-9fce17c18ed2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-2b711cb5-cb87-4591-bd88-fa4c44744f25 req-8268316f-e45b-46d4-a8f2-c2ed82aad096 tempest-TestInstancesWithCinderVolumes-108562766 None] attachment_update completed successfully. Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:31 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:31 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Creating offline snapshot c6856976-751c-43dc-8642-5c9d16d1c7eb of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Flow 'volume_create_manager' (407bd208-3c16-4171-8c1f-205d5a967789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f9d11e-4623-47f9-a904-a7c0569863f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd25daf-9473-4c9e-a108-ac7e01c341f6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f9d11e-4623-47f9-a904-a7c0569863f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-33899742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb473afc-af0f-4496-813c-cb563fa7cdfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e15ae7d85804834a3aaac79702b8511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:32Z,use_quota=True,user_id='e8b97acd05664b5da5496a30c3c3135f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e17d500-b976-4186-974f-3b85cf9d56f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e17d500-b976-4186-974f-3b85cf9d56f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f0f412-1662-4152-ad0d-db0945917115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f0f412-1662-4152-ad0d-db0945917115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb473afc-af0f-4496-813c-cb563fa7cdfa', 'volume_name': 'volume-eb473afc-af0f-4496-813c-cb563fa7cdfa', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2879d-53c1-4c44-881e-fffa8045c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2879d-53c1-4c44-881e-fffa8045c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784ad4b9-09d1-42d1-aa1e-0838ed1bdc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Volume eb473afc-af0f-4496-813c-cb563fa7cdfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb473afc-af0f-4496-813c-cb563fa7cdfa', 'volume_size': 1} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:32 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:32 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:32 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.638s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:32 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.431s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:32 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:32 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:32 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb 1G Nov 03 17:29:32 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:32 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.330s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:32 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf Nov 03 17:29:32 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:32 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb 1G" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:32 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:32 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:32 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb.cb93ce94-0ac1-4725-af37-cccd962e6fdf" returned: 0 in 0.244s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-cb93ce94-0ac1-4725-af37-cccd962e6fdf" released by "_delete_snapshot" :: held 1.812s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" released by "delete_snapshot" :: held 1.841s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['9bc5f5fa-262b-4755-a785-de2e489ce86f', '4d285ac9-e525-4e4e-97c4-474f5fce2d82', '44f7e8bc-2b67-4008-887a-0560bfbe9287', 'a50e1db5-9b41-45d5-9aa7-62ed27d96d3f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:33 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:33 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb is being set with open permissions: ugo+rw Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Delete snapshot completed successfully. Nov 03 17:29:33 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:33 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1987ea81-8ed8-4741-8005-ea8d96184624 tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-cb93ce94-0ac1-4725-af37-cccd962e6fdf-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:33 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.585s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-33899742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb473afc-af0f-4496-813c-cb563fa7cdfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e15ae7d85804834a3aaac79702b8511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:32Z,use_quota=True,user_id='e8b97acd05664b5da5496a30c3c3135f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Creating volume eb473afc-af0f-4496-813c-cb563fa7cdfa {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:33 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabfd4eb-cb39-4dee-a1e4-e7f1b419aaed]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:33 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa 1073741824 Nov 03 17:29:33 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-50d028ee-9d7d-4af2-bd2f-652ab47080d0 tempest-VolumesSnapshotListTestJSON-1807446965 None] Create snapshot completed successfully Nov 03 17:29:33 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:33 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:33 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.471s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:33 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb Nov 03 17:29:33 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:33 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa 1073741824" returned: 0 in 0.549s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:34 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa Nov 03 17:29:34 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:34 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb" released by "delete_volume" :: held 0.823s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:34 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.311s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['ce95ec3e-397c-4b15-90d5-11de74be11b3', 'a718c244-48c1-4375-b87c-a789024516fe', '9425638c-72a7-430d-87cb-ccd2a41a3fc8', '223f3ff7-be6d-48a5-8271-34716a4f1a61'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784ad4b9-09d1-42d1-aa1e-0838ed1bdc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb473afc-af0f-4496-813c-cb563fa7cdfa', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62eb436-1e70-4ad5-8fec-b35c798fcdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Creating offline snapshot 3b2cd429-6777-4660-bb51-231ff910094c of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bc5605-7b5e-4aa5-9b86-e7c0c24fc1c6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:34 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Volume volume-eb473afc-af0f-4496-813c-cb563fa7cdfa (eb473afc-af0f-4496-813c-cb563fa7cdfa): created successfully Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62eb436-1e70-4ad5-8fec-b35c798fcdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Flow 'volume_create_manager' (407bd208-3c16-4171-8c1f-205d5a967789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-029eb559-11ac-45e7-a3ff-58b5c2b26fc1 req-277ec71e-28eb-47df-a0d3-d2a89d84dd3e tempest-VolumesGetTestJSON-1140495952 None] Created volume successfully. Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:34 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:34 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:34 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:34 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4593a06b-db87-4464-98bd-225cbfb1980e req-64957fb6-af63-4676-a766-6970ef0bcd23 tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:34 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Deleted volume successfully. Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ea92945a-e901-4e85-95f2-fc320250666b tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-c5f86f8b-50ee-433d-b06d-b4fbd93da6cb-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:34 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:34 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c 1G Nov 03 17:29:34 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Acquiring lock "cinder-eb473afc-af0f-4496-813c-cb563fa7cdfa-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "cinder-eb473afc-af0f-4496-813c-cb563fa7cdfa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Acquiring lock "cinder-quobyte-eb473afc-af0f-4496-813c-cb563fa7cdfa" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:35 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c 1G" returned: 0 in 0.484s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "cinder-quobyte-eb473afc-af0f-4496-813c-cb563fa7cdfa" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:35 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c Nov 03 17:29:35 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6c210f-a318-4d49-92cf-bec4be9a7fad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:35 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa Nov 03 17:29:35 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:35 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c is being set with open permissions: ugo+rw Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:35 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c Nov 03 17:29:35 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-27b52017-3130-4555-b5a4-74cdc48963a8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-27b52017-3130-4555-b5a4-74cdc48963a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:35 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa" returned: 0 in 0.454s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec767c-19c7-4829-b64d-99124a3e4904]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:35 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa Nov 03 17:29:35 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 Nov 03 17:29:35 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:35 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c" returned: 0 in 0.311s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.659s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4593a06b-db87-4464-98bd-225cbfb1980e req-64957fb6-af63-4676-a766-6970ef0bcd23 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.267s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4593a06b-db87-4464-98bd-225cbfb1980e req-64957fb6-af63-4676-a766-6970ef0bcd23 tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e199efb6-98a5-4032-b20e-78ae283caaa7 tempest-VolumesSnapshotListTestJSON-1807446965 None] Create snapshot completed successfully Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-4593a06b-db87-4464-98bd-225cbfb1980e req-64957fb6-af63-4676-a766-6970ef0bcd23 tempest-TestInstancesWithCinderVolumes-108562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32e896d6-75e5-4851-b4c0-db0a31aa9a74', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:29:36 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-eb473afc-af0f-4496-813c-cb563fa7cdfa" returned: 0 in 0.289s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "cinder-quobyte-eb473afc-af0f-4496-813c-cb563fa7cdfa" released by "delete_volume" :: held 0.798s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-4593a06b-db87-4464-98bd-225cbfb1980e req-64957fb6-af63-4676-a766-6970ef0bcd23 tempest-TestInstancesWithCinderVolumes-108562766 None] attachment_update completed successfully. Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.quota [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Created reservations ['3b023d67-dd9a-4813-8aaa-818a6e86c1c2', '4bc0f94f-3fda-4c93-b78a-9c710efae78b', '915e2dec-335e-4ed5-b81c-4092043e07f7', 'ef91a516-aef9-404b-af39-25ae897f1ec0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:36 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:36 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8 Nov 03 17:29:36 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:36 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:36 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:36 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:36 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.manager [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b52017-3130-4555-b5a4-74cdc48963a8" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Deleted volume successfully. Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-quobyte-27b52017-3130-4555-b5a4-74cdc48963a8" released by "delete_volume" :: held 0.945s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-7ba14350-a2b7-4955-975c-cc87781c29b8 req-bc75e2bd-9b38-4097-9fda-9659dde3fc46 tempest-VolumesGetTestJSON-1140495952 None] Lock "cinder-eb473afc-af0f-4496-813c-cb563fa7cdfa-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Created reservations ['80a41caf-61d7-4e10-8afb-fa9668e83014', '7a64fb65-bf3d-4107-9ad5-7aac753fb178', '23317af8-d747-4ecf-83de-127eb2fad58d', '6c72b9dd-6aff-4b25-b31e-4aed9466c014'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:36 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:36 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:37 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.306s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Deleted volume successfully. Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-11b997e0-2b44-4043-aea7-bfc90e5e22be tempest-VolumesSnapshotTestJSON-443320749 None] Lock "cinder-27b52017-3130-4555-b5a4-74cdc48963a8-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-3b2cd429-6777-4660-bb51-231ff910094c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-3b2cd429-6777-4660-bb51-231ff910094c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-3b2cd429-6777-4660-bb51-231ff910094c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-3b2cd429-6777-4660-bb51-231ff910094c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Deleting offline snapshot 3b2cd429-6777-4660-bb51-231ff910094c of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] snapshot_file for this snap is: volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a06abf-2752-4388-908e-647f45f08b3c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:37 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c Nov 03 17:29:37 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:38 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c" returned: 0 in 0.518s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e5c22-0a81-42e3-a0aa-f016822cb783]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:38 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:38 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:38 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.422s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:38 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c Nov 03 17:29:38 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:38 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:38 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:39 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.504s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:29:39 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c" returned: 0 in 0.724s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:39 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c Nov 03 17:29:39 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:39 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.3b2cd429-6777-4660-bb51-231ff910094c" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-3b2cd429-6777-4660-bb51-231ff910094c" released by "_delete_snapshot" :: held 2.082s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" released by "delete_snapshot" :: held 2.110s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=157,cinder:DELETE=15,cinder:SELECT=164,cinder:INSERT=43 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Created reservations ['c814ead1-ec1a-484e-b299-9d7e64df52d2', 'e1ed596c-2a9c-41ed-bf0a-22b3e6bd931c', 'c370a380-7d8b-44cd-9e6b-6f41c058dc37', '979b5bb2-634e-4804-bd99-aec6c5b32e0b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Delete snapshot completed successfully. Nov 03 17:29:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4ad0bbe7-1e55-49b1-93a8-1238beaf696e tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-3b2cd429-6777-4660-bb51-231ff910094c-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-c6856976-751c-43dc-8642-5c9d16d1c7eb-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-c6856976-751c-43dc-8642-5c9d16d1c7eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-c6856976-751c-43dc-8642-5c9d16d1c7eb" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-c6856976-751c-43dc-8642-5c9d16d1c7eb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Deleting offline snapshot c6856976-751c-43dc-8642-5c9d16d1c7eb of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] snapshot_file for this snap is: volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7931cd-d65c-47a0-8d6f-c6f8951a6ca3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:41 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:41 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:41 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.550s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823bfa8-02ba-4eb8-8863-5ddf4070a793]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:41 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:41 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:42 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.489s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:42 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:42 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:42 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.621s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:42 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb Nov 03 17:29:42 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-ef363c0e-1412-42a8-8ebc-797092577876 req-2f2f0658-05fd-456b-b5cd-54b530b71953 tempest-TestInstancesWithCinderVolumes-108562766 None] Terminate volume connection completed successfully. Nov 03 17:29:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-ef363c0e-1412-42a8-8ebc-797092577876 req-2f2f0658-05fd-456b-b5cd-54b530b71953 tempest-TestInstancesWithCinderVolumes-108562766 None] Deleting attachment 17f539c9-1661-4f8c-8d6c-bfb1782adeed. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:29:43 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.c6856976-751c-43dc-8642-5c9d16d1c7eb" returned: 0 in 0.360s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-c6856976-751c-43dc-8642-5c9d16d1c7eb" released by "_delete_snapshot" :: held 2.177s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" released by "delete_snapshot" :: held 2.202s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Created reservations ['bee13e2d-8482-4598-9570-cb9babead670', '2f9185db-c2ba-47f3-ae93-19ed7b2f7b25', '847b98b4-a300-40fb-a514-5838d2bbb3be', '2e6097c0-058b-4d85-b504-cc0cbfad6e2e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Delete snapshot completed successfully. Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-28bcd4ae-bd88-42c5-8d95-f0efad232ce9 tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-c6856976-751c-43dc-8642-5c9d16d1c7eb-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-b0a0f091-312c-4b9d-a234-864f88f41100-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-b0a0f091-312c-4b9d-a234-864f88f41100-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-quobyte-b0a0f091-312c-4b9d-a234-864f88f41100" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-b0a0f091-312c-4b9d-a234-864f88f41100" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96999d3-5675-48f0-81e6-53919eba084c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:43 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 Nov 03 17:29:43 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-7295513b-c79c-4d1a-9b1d-a5beb06ad00a-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-7295513b-c79c-4d1a-9b1d-a5beb06ad00a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-7295513b-c79c-4d1a-9b1d-a5beb06ad00a" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-7295513b-c79c-4d1a-9b1d-a5beb06ad00a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Deleting offline snapshot 7295513b-c79c-4d1a-9b1d-a5beb06ad00a of volume 2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] snapshot_file for this snap is: volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cdbd22-ab10-4e9d-b736-881fbd15eba2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:44 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100" returned: 0 in 0.618s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:44 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100 Nov 03 17:29:44 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:44 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:44 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:44 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b0a0f091-312c-4b9d-a234-864f88f41100" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-b0a0f091-312c-4b9d-a234-864f88f41100" released by "delete_volume" :: held 1.111s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:44 devstack cinder-volume[86995]: WARNING cinder.quota [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178381898-1170674490 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178381898-1170674490, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:44 devstack cinder-volume[86995]: WARNING cinder.quota [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178381898-1170674490 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1178381898-1170674490, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:44 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf4168c-1f73-436a-acce-d391af55304a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:44 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Created reservations ['7337cee8-0ad4-4a30-b517-453bffd7d85f', '806707cc-5320-4d8f-9b26-ccec84559f9b', '1424af5b-535a-490f-a39e-7d2a8ed78ebe', '83b4b002-6c96-4d80-b716-75a4eb954ad9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a12b3-fe53-46ea-90e1-3235a15a8bfa]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:45 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:45 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:45 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a Nov 03 17:29:45 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:45 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Deleted volume successfully. Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad3d41d1-1a7b-4fb0-bda2-65acff67774b tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-b0a0f091-312c-4b9d-a234-864f88f41100-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:45 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a" returned: 0 in 0.643s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:45 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:45 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:46 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.499s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:46 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a Nov 03 17:29:46 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:46 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a.7295513b-c79c-4d1a-9b1d-a5beb06ad00a" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-7295513b-c79c-4d1a-9b1d-a5beb06ad00a" released by "_delete_snapshot" :: held 2.208s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" released by "delete_snapshot" :: held 2.259s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Created reservations ['5ed3a5e0-8fd7-4555-8768-d6f624133ab7', '5c6c46fe-2e77-4ee9-9bc8-806841d6cfe7', 'e2237a11-1e39-41e1-b125-87c25b328cc8', '053c151d-bca6-4a73-96f7-bfc25941f0b5'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Delete snapshot completed successfully. Nov 03 17:29:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a4d04326-568e-4fd8-8fe8-c0c8f3b7bc2b tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-7295513b-c79c-4d1a-9b1d-a5beb06ad00a-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-2cf4168c-1f73-436a-acce-d391af55304a-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-2cf4168c-1f73-436a-acce-d391af55304a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917d79f-ebc3-491f-8dc0-81a5f4fed341]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Flow 'volume_create_manager' (cb10551d-d17c-4e35-afac-de58c3a9594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0eba197-507e-4eda-9b4e-69ee12b56f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0eba197-507e-4eda-9b4e-69ee12b56f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2139087162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b08d59f-c694-40a8-8add-245dbcf8d39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a5382d1afd44fb9b10c606e034dda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:48Z,use_quota=True,user_id='b0ed5c559b7747199ea948074e854081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93526046-5098-4b60-9c2c-143c63308ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93526046-5098-4b60-9c2c-143c63308ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75e705-0882-4ff0-b446-6a6d82193398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75e705-0882-4ff0-b446-6a6d82193398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b08d59f-c694-40a8-8add-245dbcf8d39b', 'volume_name': 'volume-2b08d59f-c694-40a8-8add-245dbcf8d39b', 'volume_size': 2}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc4c6cf-a073-4b40-9c09-ca4615161042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:47 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a Nov 03 17:29:47 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc4c6cf-a073-4b40-9c09-ca4615161042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0010e3d5-ca77-410f-ad7d-97993f87f29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Volume 2b08d59f-c694-40a8-8add-245dbcf8d39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b08d59f-c694-40a8-8add-245dbcf8d39b', 'volume_size': 2} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2139087162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b08d59f-c694-40a8-8add-245dbcf8d39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a5382d1afd44fb9b10c606e034dda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:48Z,use_quota=True,user_id='b0ed5c559b7747199ea948074e854081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Creating volume 2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:48 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b 2147483648 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:48 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b 2147483648 Nov 03 17:29:48 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:48 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a" returned: 0 in 0.509s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:48 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a Nov 03 17:29:48 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-76693181-52ed-4428-b820-841faf94d446 req-3fae806d-35d8-4821-8b0d-ebfe3d0abfdd tempest-TestInstancesWithCinderVolumes-108562766 None] Terminate volume connection completed successfully. Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-76693181-52ed-4428-b820-841faf94d446 req-3fae806d-35d8-4821-8b0d-ebfe3d0abfdd tempest-TestInstancesWithCinderVolumes-108562766 None] Deleting attachment 32e896d6-75e5-4851-b4c0-db0a31aa9a74. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Flow 'volume_create_manager' (b6179c44-0619-45d5-bd1f-df32124eb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa2a226-ea1e-4fa2-b6b3-5ecaf6967677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:48 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2cf4168c-1f73-436a-acce-d391af55304a" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-quobyte-2cf4168c-1f73-436a-acce-d391af55304a" released by "delete_volume" :: held 0.928s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa2a226-ea1e-4fa2-b6b3-5ecaf6967677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1860328702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e00e2b-00c7-4154-a446-581f721f0021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158359c4ca7840918a6b4901f51ad44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:49Z,use_quota=True,user_id='3e14beb091b04f28a95d0b1182716944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a93173-364d-4493-bc98-cb984f412707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a93173-364d-4493-bc98-cb984f412707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:48 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c9f66-d4c2-4700-874d-a8a352f5e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c9f66-d4c2-4700-874d-a8a352f5e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e00e2b-00c7-4154-a446-581f721f0021', 'volume_name': 'volume-f6e00e2b-00c7-4154-a446-581f721f0021', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420cc6f8-ea69-4f07-89ee-c1c86207ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420cc6f8-ea69-4f07-89ee-c1c86207ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe2e682-69ce-4469-bc00-08d4e7ea7c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Volume f6e00e2b-00c7-4154-a446-581f721f0021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e00e2b-00c7-4154-a446-581f721f0021', 'volume_size': 1} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b 2147483648" returned: 0 in 0.739s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Created reservations ['50e39db7-e933-434d-b72e-de2546bc3a7b', '3ad2463a-7335-4bc4-88d8-1b60cfe7f32a', 'dc92c32a-3515-4acf-a61e-42a3ea47b5a4', '701bee8a-998b-4bef-a212-e33c47f02edf'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:48 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b Nov 03 17:29:48 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:48 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:48 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:49 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b" returned: 0 in 0.255s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1860328702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e00e2b-00c7-4154-a446-581f721f0021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158359c4ca7840918a6b4901f51ad44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:29:49Z,use_quota=True,user_id='3e14beb091b04f28a95d0b1182716944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Creating volume f6e00e2b-00c7-4154-a446-581f721f0021 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:29:49 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0010e3d5-ca77-410f-ad7d-97993f87f29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b08d59f-c694-40a8-8add-245dbcf8d39b', 'volume_size': 2}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd519dd-d1df-4f7a-bc32-dd6325152fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:49 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 1073741824 Nov 03 17:29:49 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:49 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Volume volume-2b08d59f-c694-40a8-8add-245dbcf8d39b (2b08d59f-c694-40a8-8add-245dbcf8d39b): created successfully Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd519dd-d1df-4f7a-bc32-dd6325152fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Flow 'volume_create_manager' (cb10551d-d17c-4e35-afac-de58c3a9594f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6477f240-c4a7-4eaa-b2f4-aa87546c1d1c tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Created volume successfully. Nov 03 17:29:49 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Deleted volume successfully. Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5734612-68f1-496f-a1d6-838ceb3fe1ba tempest-VolumesSnapshotListTestJSON-1807446965 None] Lock "cinder-2cf4168c-1f73-436a-acce-d391af55304a-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-34351d6a-617e-4f94-8a62-d4efbc1a5c5a-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-34351d6a-617e-4f94-8a62-d4efbc1a5c5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-quobyte-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae8eb7-8c72-48a0-a7a0-1f00d7abd355]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:49 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a Nov 03 17:29:49 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:49 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 1073741824" returned: 0 in 0.596s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:49 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 Nov 03 17:29:49 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:49 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" returned: 0 in 0.447s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:49 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a Nov 03 17:29:49 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:50 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021" returned: 0 in 0.358s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe2e682-69ce-4469-bc00-08d4e7ea7c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e00e2b-00c7-4154-a446-581f721f0021', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ed2d36-9c14-4d47-b00d-3a8522379f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:29:50 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Volume volume-f6e00e2b-00c7-4154-a446-581f721f0021 (f6e00e2b-00c7-4154-a446-581f721f0021): created successfully Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ed2d36-9c14-4d47-b00d-3a8522379f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Flow 'volume_create_manager' (b6179c44-0619-45d5-bd1f-df32124eb30f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:29:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9097e9c5-c394-4460-8ac9-2a019e7a1be8 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Created volume successfully. Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:50 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" returned: 0 in 0.449s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Creating offline snapshot c38c74c6-6f02-4ed7-81d3-056b0d200efb of volume 2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-34351d6a-617e-4f94-8a62-d4efbc1a5c5a" released by "delete_volume" :: held 0.966s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda494e-3470-4cef-ab05-6a4332d8d2f9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:50 devstack cinder-volume[86995]: WARNING cinder.quota [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-689241731-1872628311 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-689241731-1872628311, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:50 devstack cinder-volume[86995]: WARNING cinder.quota [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-689241731-1872628311 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-689241731-1872628311, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Created reservations ['25e06800-cfe1-4644-8f92-027af112909c', 'bb7add21-d1a9-4a44-a895-6839efd9e3fc', '11917ac7-021a-466f-9cf7-818f4eed50eb', '2d6dcb3c-4a5f-4e9a-8d41-24e8715b5b90'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:50 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b Nov 03 17:29:50 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:50 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:50 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:50 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b" returned: 0 in 0.495s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb 2G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:50 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb 2G Nov 03 17:29:50 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:51 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.461s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:51 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Deleted volume successfully. Nov 03 17:29:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2dea333e-d83d-40c8-8ad4-c765c7b0551f tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-34351d6a-617e-4f94-8a62-d4efbc1a5c5a-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:51 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb 2G" returned: 0 in 0.763s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b08d59f-c694-40a8-8add-245dbcf8d39b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:51 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b08d59f-c694-40a8-8add-245dbcf8d39b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb Nov 03 17:29:51 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:52 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b08d59f-c694-40a8-8add-245dbcf8d39b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb" returned: 0 in 0.444s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:52 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb is being set with open permissions: ugo+rw Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:52 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb Nov 03 17:29:52 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:52 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb" returned: 0 in 0.397s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:52 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info Nov 03 17:29:52 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Acquiring lock "cinder-f6e00e2b-00c7-4154-a446-581f721f0021-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "cinder-f6e00e2b-00c7-4154-a446-581f721f0021-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Acquiring lock "cinder-quobyte-f6e00e2b-00c7-4154-a446-581f721f0021" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "cinder-quobyte-f6e00e2b-00c7-4154-a446-581f721f0021" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa70dc-c6f0-4f42-8e93-dad43649e6bd]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:52 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info" returned: 0 in 0.409s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:52 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info is being set with open permissions: ugo+rw Nov 03 17:29:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:53 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info Nov 03 17:29:53 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:53 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 Nov 03 17:29:53 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:53 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.info" returned: 0 in 0.467s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4b2c912f-5c01-4b04-8310-3d59ea13c19b tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Create snapshot completed successfully Nov 03 17:29:53 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021" returned: 0 in 0.660s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:53 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021 Nov 03 17:29:53 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:53 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f6e00e2b-00c7-4154-a446-581f721f0021" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "cinder-quobyte-f6e00e2b-00c7-4154-a446-581f721f0021" released by "delete_volume" :: held 1.126s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Created reservations ['3dbcb775-1e6b-4376-9891-0635a995e618', 'e4029bec-6c4d-451a-ad97-55574d2d37af', '3d7ec646-12f6-4b8d-a314-ff2e526f9470', '37db1c78-a48c-4c2f-9dfb-6bfa508d9f5f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:54 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:54 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:54 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.346s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Deleted volume successfully. Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0ca062d6-75a1-4afd-88bf-9549c2213954 tempest-VolumeQuotasNegativeTestJSON-1245939540 None] Lock "cinder-f6e00e2b-00c7-4154-a446-581f721f0021-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "cinder-c38c74c6-6f02-4ed7-81d3-056b0d200efb-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-c38c74c6-6f02-4ed7-81d3-056b0d200efb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "cinder-quobyte-c38c74c6-6f02-4ed7-81d3-056b0d200efb" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-c38c74c6-6f02-4ed7-81d3-056b0d200efb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Deleting offline snapshot c38c74c6-6f02-4ed7-81d3-056b0d200efb of volume 2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] snapshot_file for this snap is: volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c9654-27a5-4687-86e8-43a9fb419176]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-881c0e74-2f1a-49ea-b70d-4fc0a3229564 req-50ccf229-bf47-4210-9100-1f0ecd206f79 tempest-TestInstancesWithCinderVolumes-108562766 None] Terminate volume connection completed successfully. Nov 03 17:29:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-881c0e74-2f1a-49ea-b70d-4fc0a3229564 req-50ccf229-bf47-4210-9100-1f0ecd206f79 tempest-TestInstancesWithCinderVolumes-108562766 None] Deleting attachment 31c3c26d-5571-49fd-9354-2108cc4300df. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:29:54 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb Nov 03 17:29:54 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:55 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb" returned: 0 in 0.543s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b08d59f-c694-40a8-8add-245dbcf8d39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78fbfaf-a30a-4fc7-b4cd-d31d82c4b180]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:55 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b Nov 03 17:29:55 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:55 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b" returned: 0 in 0.445s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:55 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb Nov 03 17:29:55 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-7b2f9090-c269-4e10-9ace-cbb5fba73e2e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:56 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb" returned: 0 in 0.431s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-7b2f9090-c269-4e10-9ace-cbb5fba73e2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:56 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb Nov 03 17:29:56 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "cinder-quobyte-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c061a19c-66e1-4dc5-b7b0-c1bef11271c6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:56 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e Nov 03 17:29:56 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:56 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b.c38c74c6-6f02-4ed7-81d3-056b0d200efb" returned: 0 in 0.407s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-c38c74c6-6f02-4ed7-81d3-056b0d200efb" released by "_delete_snapshot" :: held 1.994s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" released by "delete_snapshot" :: held 2.023s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Created reservations ['f8a39735-8b04-4eef-acc4-dc16b8625823', 'f66efd86-8466-41f6-b8d1-5b9b753000a8', '2d779001-9620-49b6-85d3-e447a8a5c05b', '107e92ee-f060-4751-a65f-8f408bdc7d33'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:56 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" returned: 0 in 0.513s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:56 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e Nov 03 17:29:56 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Delete snapshot completed successfully. Nov 03 17:29:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bbf4393d-14f3-432f-8c6c-48fe8211a89a tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-c38c74c6-6f02-4ed7-81d3-056b0d200efb-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:57 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-quobyte-7b2f9090-c269-4e10-9ace-cbb5fba73e2e" released by "delete_volume" :: held 0.874s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:57 devstack cinder-volume[86995]: WARNING cinder.quota [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064303563-193061069 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064303563-193061069, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:57 devstack cinder-volume[86995]: WARNING cinder.quota [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064303563-193061069 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064303563-193061069, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Created reservations ['7679334a-a92c-4fbb-bac2-fa9a6de8472a', '26b0b2c4-18d7-43e4-98f7-8a7fcd765c2b', '5838e98c-15b1-411f-b858-37e688d4a634', '1a76a7b3-765f-4fb1-8bfd-7b44cc86ddc5'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:57 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:57 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:57 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Deleted volume successfully. Nov 03 17:29:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8532f4fa-61aa-433f-a049-1369909251dc tempest-TestInstancesWithCinderVolumes-108562766 None] Lock "cinder-7b2f9090-c269-4e10-9ace-cbb5fba73e2e-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "cinder-2b08d59f-c694-40a8-8add-245dbcf8d39b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-2b08d59f-c694-40a8-8add-245dbcf8d39b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[affdb526-7656-428e-8ee1-3e4c3671987f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:58 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b Nov 03 17:29:58 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:58 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b" returned: 0 in 0.469s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:58 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b Nov 03 17:29:58 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:58 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-2b08d59f-c694-40a8-8add-245dbcf8d39b" returned: 0 in 0.299s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-quobyte-2b08d59f-c694-40a8-8add-245dbcf8d39b" released by "delete_volume" :: held 0.852s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Created reservations ['df0e0878-3212-4f0e-a3dd-799c7a9d8ddf', '312bba36-bd70-4488-9e03-95f8bcdddf74', '337be9a1-d57f-40a8-8e5f-75ff43b51f07', '3d540d11-67c8-4c03-9920-30e3c8f1451b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:29:59 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:29:59 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:29:59 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.481s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:29:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Deleted volume successfully. Nov 03 17:29:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6d8afd10-d7f5-4d3b-9f19-f6e1d3db395d tempest-VolumesSnapshotNegativeTestJSON-1374009448 None] Lock "cinder-2b08d59f-c694-40a8-8add-245dbcf8d39b-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:09 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=110,cinder:UPDATE=131,cinder:INSERT=33,cinder:DELETE=8 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:30:09 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=54,cinder:INSERT=21,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Flow 'volume_create_manager' (d3b9cd0c-2250-46b2-beca-9170f59c23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1bf5f4-32aa-4d95-bb0e-45b57af74ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1bf5f4-32aa-4d95-bb0e-45b57af74ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582457934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e623f772-1638-4f94-9fb8-6ad9329cc6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08607981868b42b7918841781d7c3b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:14Z,use_quota=True,user_id='d477f6db4eca4bb2a909cfafe33b38cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1c24e77-e520-4953-8d92-b77c22903020),volume_type_id=e1c24e77-e520-4953-8d92-b77c22903020)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6639828-f981-4a3c-9ce9-573b1d8262b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6639828-f981-4a3c-9ce9-573b1d8262b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a16366-f6b9-4625-a743-53a51c6a7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a16366-f6b9-4625-a743-53a51c6a7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e623f772-1638-4f94-9fb8-6ad9329cc6c6', 'volume_name': 'volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b7b190-0d10-472f-b037-df3c41b73605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b7b190-0d10-472f-b037-df3c41b73605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afae9096-b9e5-46d3-b814-a859e8ebd85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Volume e623f772-1638-4f94-9fb8-6ad9329cc6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6', 'volume_size': 1} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1582457934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e623f772-1638-4f94-9fb8-6ad9329cc6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08607981868b42b7918841781d7c3b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:14Z,use_quota=True,user_id='d477f6db4eca4bb2a909cfafe33b38cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1c24e77-e520-4953-8d92-b77c22903020),volume_type_id=e1c24e77-e520-4953-8d92-b77c22903020)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Creating volume e623f772-1638-4f94-9fb8-6ad9329cc6c6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:14 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 1073741824 Nov 03 17:30:14 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:15 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 1073741824" returned: 0 in 0.654s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:15 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 Nov 03 17:30:15 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:15 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6" returned: 0 in 0.360s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afae9096-b9e5-46d3-b814-a859e8ebd85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fa3279-4622-4fdb-a20a-e83ec3f1f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Volume volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 (e623f772-1638-4f94-9fb8-6ad9329cc6c6): created successfully Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fa3279-4622-4fdb-a20a-e83ec3f1f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Flow 'volume_create_manager' (d3b9cd0c-2250-46b2-beca-9170f59c23b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-60c62f57-ba63-4fa0-9ac0-c8e4c00da5a7 tempest-VolumeTypesAccessTest-1587051725 None] Created volume successfully. Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Acquiring lock "cinder-e623f772-1638-4f94-9fb8-6ad9329cc6c6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "cinder-e623f772-1638-4f94-9fb8-6ad9329cc6c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Acquiring lock "cinder-quobyte-e623f772-1638-4f94-9fb8-6ad9329cc6c6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "cinder-quobyte-e623f772-1638-4f94-9fb8-6ad9329cc6c6" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e8e82-bca4-4f8f-a6a2-9ae2ffa9e7e3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:16 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 Nov 03 17:30:16 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (8505c866-60df-4f60-adb9-b51da2e8f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbe8ec6-7916-4f6c-9bb8-d432b16da56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbe8ec6-7916-4f6c-9bb8-d432b16da56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880140460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0225b5-d3da-4004-a797-df207a2b3250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:17Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7370ae4-6c8e-4c81-b126-134843bacab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7370ae4-6c8e-4c81-b126-134843bacab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fefd04b-0d9d-4481-9695-0d3c4d78d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fefd04b-0d9d-4481-9695-0d3c4d78d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0225b5-d3da-4004-a797-df207a2b3250', 'volume_name': 'volume-df0225b5-d3da-4004-a797-df207a2b3250', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8f3912-d117-4e72-a3ce-b6269d99a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8f3912-d117-4e72-a3ce-b6269d99a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df93970a-924f-4360-a9e2-2d5446ddd447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Volume df0225b5-d3da-4004-a797-df207a2b3250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0225b5-d3da-4004-a797-df207a2b3250', 'volume_size': 1} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880140460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0225b5-d3da-4004-a797-df207a2b3250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:17Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Creating volume df0225b5-d3da-4004-a797-df207a2b3250 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:17 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 1073741824 Nov 03 17:30:17 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:17 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6" returned: 0 in 0.547s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:17 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6 Nov 03 17:30:17 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:17 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e623f772-1638-4f94-9fb8-6ad9329cc6c6" returned: 0 in 0.409s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "cinder-quobyte-e623f772-1638-4f94-9fb8-6ad9329cc6c6" released by "delete_volume" :: held 1.035s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:17 devstack cinder-volume[86995]: WARNING cinder.quota [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-200099008 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-200099008, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:30:17 devstack cinder-volume[86995]: WARNING cinder.quota [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-200099008 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-200099008, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Created reservations ['93fb6fdc-5091-4bb7-8956-b5fdea8bf41f', 'ef9b8442-57d7-4e13-ab17-5f320430078b', '7df4811d-0b57-457d-8d3f-4c6d408ad0b2', 'b52bfcaf-ded4-47fd-bc83-a3d9231bc153'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:30:17 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 1073741824" returned: 0 in 0.764s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:18 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:18 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:18 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 Nov 03 17:30:18 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:18 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df93970a-924f-4360-a9e2-2d5446ddd447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0225b5-d3da-4004-a797-df207a2b3250', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ee8d14-06bc-49c2-af56-7b22be197751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:18 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.381s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Volume volume-df0225b5-d3da-4004-a797-df207a2b3250 (df0225b5-d3da-4004-a797-df207a2b3250): created successfully Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ee8d14-06bc-49c2-af56-7b22be197751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (8505c866-60df-4f60-adb9-b51da2e8f546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Deleted volume successfully. Nov 03 17:30:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6468fb11-9cb7-492d-8e21-49ffcea8d1e4 tempest-ProjectReaderTests-2129872275 None] Created volume successfully. Nov 03 17:30:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a81b6a0f-0b41-4a36-984f-a18be38a1f69 tempest-VolumeTypesAccessTest-1587051725 None] Lock "cinder-e623f772-1638-4f94-9fb8-6ad9329cc6c6-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-df0225b5-d3da-4004-a797-df207a2b3250-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-df0225b5-d3da-4004-a797-df207a2b3250-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-quobyte-df0225b5-d3da-4004-a797-df207a2b3250" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-df0225b5-d3da-4004-a797-df207a2b3250" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6530e-f555-488f-92b9-78a1c9107249]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:20 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 Nov 03 17:30:20 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:20 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250" returned: 0 in 0.576s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:20 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250 Nov 03 17:30:20 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:20 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-df0225b5-d3da-4004-a797-df207a2b3250" returned: 0 in 0.289s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-df0225b5-d3da-4004-a797-df207a2b3250" released by "delete_volume" :: held 0.935s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:20 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Created reservations ['3317d9ec-f99a-4f13-80d0-12aa3b5b4a18', '10327cf5-3ad9-4661-a9a0-114fb99c5e10', '83f53d6a-e1d1-4d88-99e1-7567550ea4e7', 'b907a20d-b931-490c-a224-1cedce181ef3'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:21 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:21 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:21 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.348s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Deleted volume successfully. Nov 03 17:30:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1a8ddc70-3a47-4f9e-b0ee-c8d2f50ad992 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-df0225b5-d3da-4004-a797-df207a2b3250-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (c63454aa-231e-4541-ae1e-a8da9a750d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73bfdee-8952-4f6e-a75b-76a2f8a1f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73bfdee-8952-4f6e-a75b-76a2f8a1f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696276580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfdcc86-6189-4461-b0bc-73a127b092e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:23Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6444ccb9-b49c-448a-82a8-195fb3ecceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6444ccb9-b49c-448a-82a8-195fb3ecceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6abfe1e-23d9-4165-87f0-8ded83f5398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6abfe1e-23d9-4165-87f0-8ded83f5398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfdcc86-6189-4461-b0bc-73a127b092e3', 'volume_name': 'volume-6dfdcc86-6189-4461-b0bc-73a127b092e3', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e96424-a21c-40c2-b3c2-2e3b2e38e544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e96424-a21c-40c2-b3c2-2e3b2e38e544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc7d717-0bd3-4ec2-a8b3-faee0d24afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:22 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Volume 6dfdcc86-6189-4461-b0bc-73a127b092e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfdcc86-6189-4461-b0bc-73a127b092e3', 'volume_size': 1} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696276580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfdcc86-6189-4461-b0bc-73a127b092e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:23Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Creating volume 6dfdcc86-6189-4461-b0bc-73a127b092e3 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:22 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:22 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 1073741824 Nov 03 17:30:22 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:23 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 1073741824" returned: 0 in 0.613s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:23 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 Nov 03 17:30:23 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:23 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc7d717-0bd3-4ec2-a8b3-faee0d24afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfdcc86-6189-4461-b0bc-73a127b092e3', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148cb4c-dc1d-489b-8722-990e7a162f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:23 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Volume volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 (6dfdcc86-6189-4461-b0bc-73a127b092e3): created successfully Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148cb4c-dc1d-489b-8722-990e7a162f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (c63454aa-231e-4541-ae1e-a8da9a750d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-73deba6e-403c-46d8-b541-a203067b93f2 tempest-ProjectReaderTests-2129872275 None] Created volume successfully. Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-6dfdcc86-6189-4461-b0bc-73a127b092e3-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-6dfdcc86-6189-4461-b0bc-73a127b092e3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-quobyte-6dfdcc86-6189-4461-b0bc-73a127b092e3" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-6dfdcc86-6189-4461-b0bc-73a127b092e3" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[37483eef-25e3-4f43-973f-96f0de454de7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:25 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 Nov 03 17:30:25 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:25 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:25 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3 Nov 03 17:30:25 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:25 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6dfdcc86-6189-4461-b0bc-73a127b092e3" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-6dfdcc86-6189-4461-b0bc-73a127b092e3" released by "delete_volume" :: held 0.903s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:25 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Created reservations ['da91eaac-3e84-4dd7-8952-defd154586e8', '3613c860-1762-4425-9f6f-c0e36d66a4f6', 'ff6d870c-4be3-47b4-9ed4-b1d160da1b88', '34675073-fc26-48bd-844f-756dca51a566'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:26 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:26 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:26 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.398s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Deleted volume successfully. Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f53173b3-1eca-4cb5-a44b-be9a4fff9f70 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-6dfdcc86-6189-4461-b0bc-73a127b092e3-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (2a34608f-577b-48b7-9508-967c70d91883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df436aa-4a6c-4f1c-a11e-34eb59df384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df436aa-4a6c-4f1c-a11e-34eb59df384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499279148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036f5bc-bb43-4ce9-b367-18953ffb0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:27Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee10627d-8329-402e-82c3-8f69bfa73e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee10627d-8329-402e-82c3-8f69bfa73e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d45806-ef98-440e-9e00-e52f865cc6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d45806-ef98-440e-9e00-e52f865cc6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7036f5bc-bb43-4ce9-b367-18953ffb0380', 'volume_name': 'volume-7036f5bc-bb43-4ce9-b367-18953ffb0380', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f246a62-08cb-429b-a233-b4d176b0c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f246a62-08cb-429b-a233-b4d176b0c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bd0544-790a-4c2b-8c58-5462ef201593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:26 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Volume 7036f5bc-bb43-4ce9-b367-18953ffb0380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7036f5bc-bb43-4ce9-b367-18953ffb0380', 'volume_size': 1} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499279148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036f5bc-bb43-4ce9-b367-18953ffb0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:27Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Creating volume 7036f5bc-bb43-4ce9-b367-18953ffb0380 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:27 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:27 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 1073741824 Nov 03 17:30:27 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:27 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 1073741824" returned: 0 in 0.825s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:27 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 Nov 03 17:30:27 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:28 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bd0544-790a-4c2b-8c58-5462ef201593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7036f5bc-bb43-4ce9-b367-18953ffb0380', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedfeefe-10eb-4fac-ab7e-a90cc32e8490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Volume volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 (7036f5bc-bb43-4ce9-b367-18953ffb0380): created successfully Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedfeefe-10eb-4fac-ab7e-a90cc32e8490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (2a34608f-577b-48b7-9508-967c70d91883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2ba96be9-803e-437b-9603-0b883fba7727 tempest-ProjectReaderTests-2129872275 None] Created volume successfully. Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-7036f5bc-bb43-4ce9-b367-18953ffb0380-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "cinder-7036f5bc-bb43-4ce9-b367-18953ffb0380-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-quobyte-7036f5bc-bb43-4ce9-b367-18953ffb0380" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-7036f5bc-bb43-4ce9-b367-18953ffb0380" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[567913eb-2ef5-4983-9a8a-3cabd198775d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:29 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 Nov 03 17:30:29 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:30 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380" returned: 0 in 0.572s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:30 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380 Nov 03 17:30:30 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:30 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7036f5bc-bb43-4ce9-b367-18953ffb0380" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-7036f5bc-bb43-4ce9-b367-18953ffb0380" released by "delete_volume" :: held 1.060s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Created reservations ['b1807034-eaf3-42ba-957f-f565ed06398d', '86a55486-8bc8-44fa-b3a7-5fb402565e30', '1fe4672e-849a-46c8-8de0-d80b0a1c6cef', '21bd9059-b30e-41d7-8228-a22c3d448b27'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:30 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:30 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:31 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.435s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:31 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Deleted volume successfully. Nov 03 17:30:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3a68ff02-15b5-4dad-ba68-a8fdef56a1fe tempest-ProjectReaderTests-2129872275 None] Lock "cinder-7036f5bc-bb43-4ce9-b367-18953ffb0380-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (d815c990-6694-4c95-b1c5-53c7131a12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9714a8-c5a4-4456-a543-60bc73bad14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9714a8-c5a4-4456-a543-60bc73bad14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112227262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8f9139-e665-4a3e-bebf-b71a17e6b878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:32Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ba2828-4ade-4712-a692-2bbb96db77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ba2828-4ade-4712-a692-2bbb96db77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750a3511-a737-4a95-bea1-425e5661b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750a3511-a737-4a95-bea1-425e5661b0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8f9139-e665-4a3e-bebf-b71a17e6b878', 'volume_name': 'volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235cf332-dbf9-40b9-b2f5-809ddc98009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235cf332-dbf9-40b9-b2f5-809ddc98009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a9ac5-e528-40ed-877e-1f0433aa924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Volume 8b8f9139-e665-4a3e-bebf-b71a17e6b878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878', 'volume_size': 1} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112227262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8f9139-e665-4a3e-bebf-b71a17e6b878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662233a326341e2b2dc2ed4ab5c0cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:32Z,use_quota=True,user_id='91b99adbbe894abea368bd6135629c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Creating volume 8b8f9139-e665-4a3e-bebf-b71a17e6b878 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:32 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:32 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 1073741824 Nov 03 17:30:32 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:32 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 1073741824" returned: 0 in 0.599s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:33 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 Nov 03 17:30:33 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:33 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a9ac5-e528-40ed-877e-1f0433aa924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a13ca-1022-44dd-b1dd-4ddf19904988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:33 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Volume volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 (8b8f9139-e665-4a3e-bebf-b71a17e6b878): created successfully Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a13ca-1022-44dd-b1dd-4ddf19904988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Flow 'volume_create_manager' (d815c990-6694-4c95-b1c5-53c7131a12f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ce824c17-42d6-44cb-858c-9e10728c511b tempest-ProjectReaderTests-2129872275 None] Created volume successfully. Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-8b8f9139-e665-4a3e-bebf-b71a17e6b878-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-8b8f9139-e665-4a3e-bebf-b71a17e6b878-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "cinder-quobyte-8b8f9139-e665-4a3e-bebf-b71a17e6b878" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-8b8f9139-e665-4a3e-bebf-b71a17e6b878" acquired by "delete_volume" :: waited 0.050s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145273f-d67e-4438-bc26-563e4801ce9b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:34 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 Nov 03 17:30:34 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:35 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878" returned: 0 in 0.731s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:35 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878 Nov 03 17:30:35 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:35 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8b8f9139-e665-4a3e-bebf-b71a17e6b878" returned: 0 in 0.451s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-quobyte-8b8f9139-e665-4a3e-bebf-b71a17e6b878" released by "delete_volume" :: held 1.256s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Created reservations ['202ec4a6-f0ac-4dda-b6ac-20194c3346f7', '276b6e0f-c1de-408c-b794-ff262cae81e1', '495fd3c1-0650-48ca-a3d8-c94c64d5c7e4', 'a244f1be-eaad-4737-a43c-4500fd0e5ac7'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:36 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:36 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:36 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.356s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Deleted volume successfully. Nov 03 17:30:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f5dc1889-9ccf-4bc9-8455-2cb7a9c0b5c1 tempest-ProjectReaderTests-2129872275 None] Lock "cinder-8b8f9139-e665-4a3e-bebf-b71a17e6b878-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:38 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:30:39 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:39 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.443s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:30:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:30:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:30:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Flow 'volume_create_manager' (5d85a9e2-aaca-44a1-9636-279e64474205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c281bdd-caf2-444e-90b1-d12a1e83515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c281bdd-caf2-444e-90b1-d12a1e83515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1561801116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8032481111f042e0a01a92f5569a64fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:41Z,use_quota=True,user_id='af72b158e2844c878961aa60038ba2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e536d348-9563-4238-91a1-1c2d6a3c873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e536d348-9563-4238-91a1-1c2d6a3c873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f5b514-4852-4f69-9226-36fb6156b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f5b514-4852-4f69-9226-36fb6156b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22', 'volume_name': 'volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d66a70d-0538-4c78-8448-c94bcbd7dfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d66a70d-0538-4c78-8448-c94bcbd7dfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d0cee4-d76b-443d-b901-507abda5280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Volume e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22', 'volume_size': 1} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1561801116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8032481111f042e0a01a92f5569a64fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:41Z,use_quota=True,user_id='af72b158e2844c878961aa60038ba2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Creating volume e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:41 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:41 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 1073741824 Nov 03 17:30:41 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:42 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 1073741824" returned: 0 in 0.667s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:42 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 Nov 03 17:30:42 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:42 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" returned: 0 in 0.352s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d0cee4-d76b-443d-b901-507abda5280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bca690-61ca-4492-9662-06922c59fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Volume volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 (e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22): created successfully Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bca690-61ca-4492-9662-06922c59fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Flow 'volume_create_manager' (5d85a9e2-aaca-44a1-9636-279e64474205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c8138efa-9196-41b4-9e29-b1f9716c08b9 tempest-TestMinimumBasicScenario-144083940 None] Created volume successfully. Nov 03 17:30:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43988564-c237-49f5-a9dd-aa8256b80630 req-77ba8457-59e9-46dc-a5ea-e5df9d4f582d tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43988564-c237-49f5-a9dd-aa8256b80630 req-77ba8457-59e9-46dc-a5ea-e5df9d4f582d tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-43988564-c237-49f5-a9dd-aa8256b80630 req-77ba8457-59e9-46dc-a5ea-e5df9d4f582d tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-43988564-c237-49f5-a9dd-aa8256b80630 req-77ba8457-59e9-46dc-a5ea-e5df9d4f582d tempest-TestMinimumBasicScenario-144083940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6aa0b339-1d5c-48ca-a8c0-42956ba04516', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:30:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-43988564-c237-49f5-a9dd-aa8256b80630 req-77ba8457-59e9-46dc-a5ea-e5df9d4f582d tempest-TestMinimumBasicScenario-144083940 None] attachment_update completed successfully. Nov 03 17:30:54 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=47,cinder:UPDATE=62,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:30:54 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=40,cinder:UPDATE=57,cinder:DELETE=8,cinder:INSERT=10 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Flow 'volume_create_manager' (e9e7b261-fcd5-463e-a269-268686588e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0ce59c-4fc6-426d-9812-197510641fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0ce59c-4fc6-426d-9812-197510641fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-516258511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f7ed88-628b-4da6-b334-0682529701be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dfee3e1cd34f7f822ef4f49ef15ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:56Z,use_quota=True,user_id='5e8fbf6ebbd0404a93a57871e68daa2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966d50c-0bd5-4b59-832f-af176a05cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966d50c-0bd5-4b59-832f-af176a05cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6d35f2-3294-42af-bfea-fdc365ff8997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6d35f2-3294-42af-bfea-fdc365ff8997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f7ed88-628b-4da6-b334-0682529701be', 'volume_name': 'volume-08f7ed88-628b-4da6-b334-0682529701be', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19830d3e-8985-4aab-a61e-52cf3a845990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19830d3e-8985-4aab-a61e-52cf3a845990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce5facd-ebf6-4237-a48a-c1d9e0a96d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Volume 08f7ed88-628b-4da6-b334-0682529701be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f7ed88-628b-4da6-b334-0682529701be', 'volume_size': 1} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-516258511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f7ed88-628b-4da6-b334-0682529701be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dfee3e1cd34f7f822ef4f49ef15ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:30:56Z,use_quota=True,user_id='5e8fbf6ebbd0404a93a57871e68daa2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Creating volume 08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:30:56 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:30:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:56 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be 1073741824 Nov 03 17:30:56 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:57 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be 1073741824" returned: 0 in 0.561s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:57 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:30:57 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:57 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.452s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce5facd-ebf6-4237-a48a-c1d9e0a96d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f7ed88-628b-4da6-b334-0682529701be', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da0222-e9a4-4eda-97a5-5a7975440c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:30:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Volume volume-08f7ed88-628b-4da6-b334-0682529701be (08f7ed88-628b-4da6-b334-0682529701be): created successfully Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da0222-e9a4-4eda-97a5-5a7975440c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:30:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Flow 'volume_create_manager' (e9e7b261-fcd5-463e-a269-268686588e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:30:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-31639b90-ebf4-4a11-870d-09ea47dcf8eb tempest-TestImageHashVerification-2043125443 None] Created volume successfully. Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0018b24-5cca-4fb0-89b1-4040ea54a99d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:30:59 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:30:59 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:30:59 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.396s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073e076-055a-4fba-8c6c-da29627a4918]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:30:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:00 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:31:00 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:00 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be /opt/stack/data/cinder/conversion/08f7ed88-628b-4da6-b334-0682529701be.temp_image.ed69b74f-8180-49c0-a40b-872f6ab6b2977jpk4htm.img {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:00 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be /opt/stack/data/cinder/conversion/08f7ed88-628b-4da6-b334-0682529701be.temp_image.ed69b74f-8180-49c0-a40b-872f6ab6b2977jpk4htm.img Nov 03 17:31:00 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:07 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:31:08 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be /opt/stack/data/cinder/conversion/08f7ed88-628b-4da6-b334-0682529701be.temp_image.ed69b74f-8180-49c0-a40b-872f6ab6b2977jpk4htm.img" returned: 0 in 8.169s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c66b0d-5c94-47b3-89a6-7ff47b7af084]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:08 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:31:08 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:09 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.595s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:09 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/conversion/08f7ed88-628b-4da6-b334-0682529701be.temp_image.ed69b74f-8180-49c0-a40b-872f6ab6b2977jpk4htm.img {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:31:09 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Converted 1024.00 MB image at 125.32 MB/s Nov 03 17:31:09 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] ed69b74f-8180-49c0-a40b-872f6ab6b297 was raw, no need to convert to raw {{(pid=86995) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:31:09 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Flow 'volume_create_manager' (e07e5b57-a4e7-4c85-9866-1ac699ff70a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea441996-f4a8-4607-b1ff-c705f30b7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea441996-f4a8-4607-b1ff-c705f30b7f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039451774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d16a88-a445-4560-a72e-69b6a520a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206a7dd9abd140b28c95806152c69692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:31:18Z,use_quota=True,user_id='f2da3e00f5164874a8c3017617193675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28205a28-5b7d-476f-89d8-2e32cf594490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28205a28-5b7d-476f-89d8-2e32cf594490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b4eb6d-0d29-4573-b8fa-27ae68ddfd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b4eb6d-0d29-4573-b8fa-27ae68ddfd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d16a88-a445-4560-a72e-69b6a520a8a8', 'volume_name': 'volume-60d16a88-a445-4560-a72e-69b6a520a8a8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09acfb76-97a7-4cec-a4aa-f33b3c0646f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09acfb76-97a7-4cec-a4aa-f33b3c0646f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476f2ad6-b25f-43a7-9111-89d7f350b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Volume 60d16a88-a445-4560-a72e-69b6a520a8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d16a88-a445-4560-a72e-69b6a520a8a8', 'volume_size': 1} Nov 03 17:31:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:28 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:31:28 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=4 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.650s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Uploaded volume to glance image-id: ed69b74f-8180-49c0-a40b-872f6ab6b297. {{(pid=86995) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.579s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039451774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d16a88-a445-4560-a72e-69b6a520a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206a7dd9abd140b28c95806152c69692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:31:18Z,use_quota=True,user_id='f2da3e00f5164874a8c3017617193675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Creating volume 60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:31:31 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:31 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 1073741824 Nov 03 17:31:31 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5b8f5044-e8e4-4d56-8cb7-487dc0a28add tempest-TestImageHashVerification-2043125443 None] Copy volume to image completed successfully. Nov 03 17:31:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-e3b3a806-6e55-41d2-b636-b441107bf42f req-42bce8ca-a0af-4683-a42c-04064bf97817 tempest-TestMinimumBasicScenario-144083940 None] Terminate volume connection completed successfully. Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-e3b3a806-6e55-41d2-b636-b441107bf42f req-42bce8ca-a0af-4683-a42c-04064bf97817 tempest-TestMinimumBasicScenario-144083940 None] Deleting attachment 6aa0b339-1d5c-48ca-a8c0-42956ba04516. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:31:31 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 1073741824" returned: 0 in 0.576s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:31 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:31:31 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:32 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476f2ad6-b25f-43a7-9111-89d7f350b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d16a88-a445-4560-a72e-69b6a520a8a8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7c7627-2880-4c29-acf0-651afedbc132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Volume volume-60d16a88-a445-4560-a72e-69b6a520a8a8 (60d16a88-a445-4560-a72e-69b6a520a8a8): created successfully Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7c7627-2880-4c29-acf0-651afedbc132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Flow 'volume_create_manager' (e07e5b57-a4e7-4c85-9866-1ac699ff70a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:31:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4c864ca1-4293-47ac-88f8-b94c32bc2988 tempest-VolumesActionsTest-936447654 None] Created volume successfully. Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "cinder-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "cinder-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "cinder-quobyte-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "cinder-quobyte-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d14176-03eb-46bd-8742-7d8924bb1ea0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Acquiring lock "cinder-08f7ed88-628b-4da6-b334-0682529701be-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "cinder-08f7ed88-628b-4da6-b334-0682529701be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Acquiring lock "cinder-quobyte-08f7ed88-628b-4da6-b334-0682529701be" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "cinder-quobyte-08f7ed88-628b-4da6-b334-0682529701be" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f20180d-01cc-49ac-b1cd-cbac1337971d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:32 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 Nov 03 17:31:32 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:32 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:31:32 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:33 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" returned: 0 in 0.424s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:33 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22 Nov 03 17:31:33 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:33 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:33 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be Nov 03 17:31:33 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:33 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" returned: 0 in 0.299s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "cinder-quobyte-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22" released by "delete_volume" :: held 0.788s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Created reservations ['f1da89c6-e303-4aa8-a7e7-be4b78b24104', '2f09de94-b351-434e-9aa1-666d9ed3ef8f', '22748397-fe02-499b-a4a5-17d3a1a354f1', 'e93c36cf-5e35-4a49-814f-b96612de8b41'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:31:33 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-08f7ed88-628b-4da6-b334-0682529701be" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "cinder-quobyte-08f7ed88-628b-4da6-b334-0682529701be" released by "delete_volume" :: held 0.797s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:33 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:31:33 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Created reservations ['37b20ff6-4551-4166-89c4-7a5ba9fc459e', 'e876259a-5095-4f34-96a5-ea47f3d0dec5', 'c56438e3-de25-4704-8c73-91322e3badb2', 'ffacdc06-b604-4aeb-86ce-8f7bcc321c5e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:33 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:31:33 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:34 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.371s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:31:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Deleted volume successfully. Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80625a1e-d7ce-4805-bdbd-344a13d85d8b tempest-TestMinimumBasicScenario-144083940 None] Lock "cinder-e4f61b54-5ff8-4fc5-b7fa-de6c8661bc22-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:34 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.375s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:31:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Deleted volume successfully. Nov 03 17:31:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc99ab23-29b9-41b4-b106-3cd088a67d05 tempest-TestImageHashVerification-2043125443 None] Lock "cinder-08f7ed88-628b-4da6-b334-0682529701be-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:38 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:31:38 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:39 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.351s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:31:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:31:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:31:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2de71fa3-ce16-4edd-b0a7-bfc66babb055 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" by "attach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2de71fa3-ce16-4edd-b0a7-bfc66babb055 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" acquired by "attach_volume" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2de71fa3-ce16-4edd-b0a7-bfc66babb055 tempest-VolumesActionsTest-936447654 None] Attaching volume 60d16a88-a445-4560-a72e-69b6a520a8a8 to instance 67606a88-8cec-4b86-8918-184d77201a53 at mountpoint /dev/vdb on host None. Nov 03 17:31:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2de71fa3-ce16-4edd-b0a7-bfc66babb055 tempest-VolumesActionsTest-936447654 None] Attach volume completed successfully. Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2de71fa3-ce16-4edd-b0a7-bfc66babb055 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" released by "attach_volume" :: held 0.143s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df75a1c-47e4-43b2-bba7-9c7e6c597809 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" by "detach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df75a1c-47e4-43b2-bba7-9c7e6c597809 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:31:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9df75a1c-47e4-43b2-bba7-9c7e6c597809 tempest-VolumesActionsTest-936447654 None] Detaching volume 60d16a88-a445-4560-a72e-69b6a520a8a8 from instance 67606a88-8cec-4b86-8918-184d77201a53. Nov 03 17:31:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9df75a1c-47e4-43b2-bba7-9c7e6c597809 tempest-VolumesActionsTest-936447654 None] Detach volume completed successfully. Nov 03 17:31:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df75a1c-47e4-43b2-bba7-9c7e6c597809 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Flow 'volume_create_manager' (8ea0bd2a-ad1c-4b35-9e6a-2052e33d1a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f33703c-7705-4a89-a28a-b076e416f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f33703c-7705-4a89-a28a-b076e416f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890d0261-9284-4622-85fe-4b2e6d2a0cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49419fcbe6d54e94bf0de357b629890e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:31:55Z,use_quota=True,user_id='76afa2eb465f4a74b2f5c7c40242fb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a2e0815-5e68-405d-92d3-ade0c01707e6),volume_type_id=1a2e0815-5e68-405d-92d3-ade0c01707e6)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ccb31-5d51-49bd-aa03-617edb34746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ccb31-5d51-49bd-aa03-617edb34746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4400571-8d4b-4472-a173-4a4964db69f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4400571-8d4b-4472-a173-4a4964db69f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '890d0261-9284-4622-85fe-4b2e6d2a0cb5', 'volume_name': 'volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5', 'volume_size': 1, 'image_id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52d55e5facf8be29867efc2f88f54360', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49419fcbe6d54e94bf0de357b629890e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f288686957a781fad04c64a5daf58669e874d65c86728cae0d5ceb9c7347c42683ea4190a24c3b30dfb2904f65ca5755bbc55bdb4ce9822b268ff394b6cff02', 'id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'created_at': datetime.datetime(2026, 11, 3, 16, 31, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c0c1c-84c5-45f3-8eeb-d8ed45e5cf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c0c1c-84c5-45f3-8eeb-d8ed45e5cf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa871005-f84f-45e9-b148-08db6b2b0c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:31:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5', 'volume_size': 1, 'image_id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52d55e5facf8be29867efc2f88f54360', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49419fcbe6d54e94bf0de357b629890e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f288686957a781fad04c64a5daf58669e874d65c86728cae0d5ceb9c7347c42683ea4190a24c3b30dfb2904f65ca5755bbc55bdb4ce9822b268ff394b6cff02', 'id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'created_at': datetime.datetime(2026, 11, 3, 16, 31, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Trying to clone 890d0261-9284-4622-85fe-4b2e6d2a0cb5 from image e9a54f20-99db-43b5-bf47-6e0244edb1c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:31:55 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[99162e36-8b04-49b4-95ce-2b2ed49a5895]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:55 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:31:55 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:56 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:56 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:31:56 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:56 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Temporary image e9a54f20-99db-43b5-bf47-6e0244edb1c3 is fetched for user 76afa2eb465f4a74b2f5c7c40242fb58. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[58631cdd-e23b-48bd-a24e-4bf2fa6a5ede]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:56 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:31:56 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:57 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:57 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:31:57 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:57 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 1 in 0.519s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890d0261-9284-4622-85fe-4b2e6d2a0cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49419fcbe6d54e94bf0de357b629890e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:31:55Z,use_quota=True,user_id='76afa2eb465f4a74b2f5c7c40242fb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a2e0815-5e68-405d-92d3-ade0c01707e6),volume_type_id=1a2e0815-5e68-405d-92d3-ade0c01707e6)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Creating volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:31:57 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:31:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:57 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1073741824 Nov 03 17:31:57 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:58 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1073741824" returned: 0 in 0.889s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:58 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 Nov 03 17:31:58 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:58 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5" returned: 0 in 0.352s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:31:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Attempting download of e9a54f20-99db-43b5-bf47-6e0244edb1c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}])) to volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3b649a-20c3-4d87-a46d-2c338c00f5b1]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:59 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp Nov 03 17:31:59 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:59 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:31:59 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp Nov 03 17:31:59 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:31:59 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp" returned: 1 in 0.444s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9a54f20-99db-43b5-bf47-6e0244edb1c3_84r9uaxp' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[75239578-a80c-4286-833e-c63e1a9152b9]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:31:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:00 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:32:00 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fead9185-1101-434c-994e-fa48c24bb3b0 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" by "attach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fead9185-1101-434c-994e-fa48c24bb3b0 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" acquired by "attach_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fead9185-1101-434c-994e-fa48c24bb3b0 tempest-VolumesActionsTest-936447654 None] Attaching volume 60d16a88-a445-4560-a72e-69b6a520a8a8 to instance f630480e-2764-4fb4-b107-687d3625e2fd at mountpoint /dev/vdb on host None. Nov 03 17:32:00 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fead9185-1101-434c-994e-fa48c24bb3b0 tempest-VolumesActionsTest-936447654 None] Attach volume completed successfully. Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fead9185-1101-434c-994e-fa48c24bb3b0 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8" released by "attach_volume" :: held 0.189s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:00 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD Nov 03 17:32:00 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:00 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD" returned: 1 in 0.600s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] e9a54f20-99db-43b5-bf47-6e0244edb1c3 was raw, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:32:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:01 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 Nov 03 17:32:01 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a7a1b92-acb1-492c-a7ee-8bba5ebcd4c0 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" by "detach_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a7a1b92-acb1-492c-a7ee-8bba5ebcd4c0 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0a7a1b92-acb1-492c-a7ee-8bba5ebcd4c0 tempest-VolumesActionsTest-936447654 None] Detaching volume 60d16a88-a445-4560-a72e-69b6a520a8a8 from instance f630480e-2764-4fb4-b107-687d3625e2fd. Nov 03 17:32:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0a7a1b92-acb1-492c-a7ee-8bba5ebcd4c0 tempest-VolumesActionsTest-936447654 None] Detach volume completed successfully. Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a7a1b92-acb1-492c-a7ee-8bba5ebcd4c0 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:01 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5" returned: 0 in 0.990s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e9a54f20-99db-43b5-bf47-6e0244edb1c3_7my1p9tddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:32:01 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:32:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:02 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1G Nov 03 17:32:02 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:02 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 1G" returned: 0 in 0.566s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Downloaded image e9a54f20-99db-43b5-bf47-6e0244edb1c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}])) to volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Temporary image e9a54f20-99db-43b5-bf47-6e0244edb1c3 for user 76afa2eb465f4a74b2f5c7c40242fb58 is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Marking volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Copying metadata from image e9a54f20-99db-43b5-bf47-6e0244edb1c3 to 890d0261-9284-4622-85fe-4b2e6d2a0cb5. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Creating volume glance metadata for volume 890d0261-9284-4622-85fe-4b2e6d2a0cb5 backed by image e9a54f20-99db-43b5-bf47-6e0244edb1c3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '52d55e5facf8be29867efc2f88f54360', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa871005-f84f-45e9-b148-08db6b2b0c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5', 'volume_size': 1, 'image_id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52d55e5facf8be29867efc2f88f54360', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49419fcbe6d54e94bf0de357b629890e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f288686957a781fad04c64a5daf58669e874d65c86728cae0d5ceb9c7347c42683ea4190a24c3b30dfb2904f65ca5755bbc55bdb4ce9822b268ff394b6cff02', 'id': 'e9a54f20-99db-43b5-bf47-6e0244edb1c3', 'created_at': datetime.datetime(2026, 11, 3, 16, 31, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9a54f20-99db-43b5-bf47-6e0244edb1c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cf3262-6724-4825-86fc-099c0ff190bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:02 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Volume volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 (890d0261-9284-4622-85fe-4b2e6d2a0cb5): created successfully Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cf3262-6724-4825-86fc-099c0ff190bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Flow 'volume_create_manager' (8ea0bd2a-ad1c-4b35-9e6a-2052e33d1a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c94e507c-222b-4ec4-90c7-808d963c0b2d tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Created volume successfully. Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Acquiring lock "cinder-890d0261-9284-4622-85fe-4b2e6d2a0cb5-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "cinder-890d0261-9284-4622-85fe-4b2e6d2a0cb5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Acquiring lock "cinder-quobyte-890d0261-9284-4622-85fe-4b2e6d2a0cb5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "cinder-quobyte-890d0261-9284-4622-85fe-4b2e6d2a0cb5" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8722ae02-10c8-4335-aa0a-80b2c731a309]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:03 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 Nov 03 17:32:03 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:03 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:03 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5 Nov 03 17:32:03 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:03 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-890d0261-9284-4622-85fe-4b2e6d2a0cb5" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "cinder-quobyte-890d0261-9284-4622-85fe-4b2e6d2a0cb5" released by "delete_volume" :: held 0.898s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:03 devstack cinder-volume[86995]: WARNING cinder.quota [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:32:03 devstack cinder-volume[86995]: WARNING cinder.quota [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Created reservations ['e0a710f1-c7fc-4988-88e7-9360087c6981', 'fb332e4c-f3c0-432c-b520-b0b0f71a589a', 'd3533f5b-16a8-4672-8eb6-ccac946609ce', '17f073f5-ad3a-4e07-8174-5242a3e6296b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:04 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:04 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:04 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.276s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Deleted volume successfully. Nov 03 17:32:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-104327fe-6e14-4155-9f89-4a987afd2dfc tempest-VolumeAndVolumeTypeFromImageTest-357065142 None] Lock "cinder-890d0261-9284-4622-85fe-4b2e6d2a0cb5-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[274bcca2-2bf7-462a-a6a6-06819cf5d1b6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:07 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:07 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:07 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.433s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[71505901-6222-42d4-9283-59ac949b386e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:07 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:07 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:08 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.563s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.74aad8b2-2091-415f-b231-6d1b37c8f257o54q91s6.img {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:08 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.74aad8b2-2091-415f-b231-6d1b37c8f257o54q91s6.img Nov 03 17:32:08 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (ec0f07c8-4499-4632-b48a-aaf0281b9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361351ee-da6c-4e1c-b603-59ee571b2a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361351ee-da6c-4e1c-b603-59ee571b2a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-577098807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b943b4fc-bf7b-4939-8acf-eb0245dd681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:13Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046292ca-bb3e-4895-acb4-f71c42fb0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046292ca-bb3e-4895-acb4-f71c42fb0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2815d1b-8e75-41ce-b969-e05ca46e5102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2815d1b-8e75-41ce-b969-e05ca46e5102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b943b4fc-bf7b-4939-8acf-eb0245dd681e', 'volume_name': 'volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b372765d-81db-40f4-a983-b3db75cd5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b372765d-81db-40f4-a983-b3db75cd5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ff08e3-7e86-4c70-8cdf-4167998da347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Volume b943b4fc-bf7b-4939-8acf-eb0245dd681e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e', 'volume_size': 1} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (05313ffd-45bc-436f-9b8f-73d29d7fcd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2b9987-85bf-44a4-99e5-c0df8c88da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2b9987-85bf-44a4-99e5-c0df8c88da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433083045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecede3c0-2ae6-415b-98f9-cf3eac4b6556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:14Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077b7b2f-16ed-4c6a-b1a7-c0828b5885ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077b7b2f-16ed-4c6a-b1a7-c0828b5885ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2adadca-4206-4280-84af-d5cce44f7175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2adadca-4206-4280-84af-d5cce44f7175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecede3c0-2ae6-415b-98f9-cf3eac4b6556', 'volume_name': 'volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26eb2af-4fb3-4e45-9301-6f0789c184a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26eb2af-4fb3-4e45-9301-6f0789c184a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db27c14-ae92-4f6f-98aa-0132a0554083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Volume ecede3c0-2ae6-415b-98f9-cf3eac4b6556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556', 'volume_size': 1} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (c4d4a5ba-fa95-4351-a8d8-18adb6be5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae324257-deec-4185-8519-300ba8056d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae324257-deec-4185-8519-300ba8056d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782153460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699eaff0-da71-4a84-8be1-51475c05a550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:14Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa75300c-c693-4748-9d28-712544f4f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa75300c-c693-4748-9d28-712544f4f213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e633235-b829-4f53-853c-4261d1b4d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e633235-b829-4f53-853c-4261d1b4d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699eaff0-da71-4a84-8be1-51475c05a550', 'volume_name': 'volume-699eaff0-da71-4a84-8be1-51475c05a550', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae03e07a-2989-4479-bb8b-d107f8504c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae03e07a-2989-4479-bb8b-d107f8504c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9118a5-06de-4627-88b8-04db723cdf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Volume 699eaff0-da71-4a84-8be1-51475c05a550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699eaff0-da71-4a84-8be1-51475c05a550', 'volume_size': 1} Nov 03 17:32:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (0cb45636-107b-4f1c-bed6-aaf7d7abb867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31581462-8939-4a9f-8ca4-6c452609a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31581462-8939-4a9f-8ca4-6c452609a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886977405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fb6204-dd8c-42c8-8cac-443d5e340317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:15Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3f5435-91f5-4bb4-a0fd-34c421c1073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3f5435-91f5-4bb4-a0fd-34c421c1073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0367c911-0cc1-47d2-b542-b52e6ac54746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0367c911-0cc1-47d2-b542-b52e6ac54746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fb6204-dd8c-42c8-8cac-443d5e340317', 'volume_name': 'volume-10fb6204-dd8c-42c8-8cac-443d5e340317', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421742b0-9a69-42c0-a159-9d4e986b0238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421742b0-9a69-42c0-a159-9d4e986b0238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5376327f-9c6e-4f7c-9bce-6c45b00d06fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Volume 10fb6204-dd8c-42c8-8cac-443d5e340317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fb6204-dd8c-42c8-8cac-443d5e340317', 'volume_size': 1} Nov 03 17:32:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (c6ac57dc-2bd8-4a35-a8e2-aa9b22728d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9518faf8-8558-4df8-93e1-6f213b26df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9518faf8-8558-4df8-93e1-6f213b26df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309753365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7fc06a-f294-4481-91e4-8f04acc39931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:16Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7531c1cf-181c-46a3-8e4e-377a86178473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7531c1cf-181c-46a3-8e4e-377a86178473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68af9622-1194-47d8-a0a9-407e316792ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68af9622-1194-47d8-a0a9-407e316792ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7fc06a-f294-4481-91e4-8f04acc39931', 'volume_name': 'volume-7c7fc06a-f294-4481-91e4-8f04acc39931', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca072b-3927-4ff1-9766-03d45ad8db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca072b-3927-4ff1-9766-03d45ad8db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728975c8-c315-4520-b7e6-6a7868bf7210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Volume 7c7fc06a-f294-4481-91e4-8f04acc39931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7fc06a-f294-4481-91e4-8f04acc39931', 'volume_size': 1} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:16 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.74aad8b2-2091-415f-b231-6d1b37c8f257o54q91s6.img" returned: 0 in 8.554s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8002fd33-393c-4eca-88ac-9f433a39b3d6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:16 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:16 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:17 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.598s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:17 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.74aad8b2-2091-415f-b231-6d1b37c8f257o54q91s6.img {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:32:17 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Converted 1024.00 MB image at 119.70 MB/s Nov 03 17:32:17 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] 74aad8b2-2091-415f-b231-6d1b37c8f257 was raw, no need to convert to raw {{(pid=86995) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Flow 'volume_create_manager' (044451e0-f57a-4b75-ae71-6ae641e4890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b4cba-f9b7-4f39-b39c-4b287db0938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b4cba-f9b7-4f39-b39c-4b287db0938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1936358854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd4c85-bdf7-44b9-97ae-d5d24d42443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815abd58aaf4b44ac31bd72a9db2dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:24Z,use_quota=True,user_id='d4049ceaa94947f09b4111d957c50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8831a5d4-3343-4a16-aeee-c5125ada53b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8831a5d4-3343-4a16-aeee-c5125ada53b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a008202-22b9-4723-a9ee-ca0077d57681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a008202-22b9-4723-a9ee-ca0077d57681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddd4c85-bdf7-44b9-97ae-d5d24d42443f', 'volume_name': 'volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9240-0002-41c1-8fa6-039be52d3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9240-0002-41c1-8fa6-039be52d3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7b7331-8c2b-4ca6-bee6-e9b956295b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume 9ddd4c85-bdf7-44b9-97ae-d5d24d42443f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f', 'volume_size': 1} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Flow 'volume_create_manager' (618467f6-440d-4e75-b980-42f04eb934b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eac790-6330-4aa7-b991-68843611d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eac790-6330-4aa7-b991-68843611d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1929286636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9829a2e-c4c2-413e-b3e2-66e7ebba4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815abd58aaf4b44ac31bd72a9db2dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:24Z,use_quota=True,user_id='d4049ceaa94947f09b4111d957c50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b43d15-6845-43da-9539-e70d2dbc50e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b43d15-6845-43da-9539-e70d2dbc50e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782f333-e042-42a4-a08d-1763d8a6373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782f333-e042-42a4-a08d-1763d8a6373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9829a2e-c4c2-413e-b3e2-66e7ebba4a85', 'volume_name': 'volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9f448d-72fa-4027-b45e-9e6816ccbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9f448d-72fa-4027-b45e-9e6816ccbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eae9a8-1b60-4ec8-81b1-9d4153f5427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:24 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume a9829a2e-c4c2-413e-b3e2-66e7ebba4a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85', 'volume_size': 1} Nov 03 17:32:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:34 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=40,cinder:SELECT=44,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:32:34 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=51,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=14 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:38 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:38 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:39 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.326s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Uploaded volume to glance image-id: 74aad8b2-2091-415f-b231-6d1b37c8f257. {{(pid=86995) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.997s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-577098807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b943b4fc-bf7b-4939-8acf-eb0245dd681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:13Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Creating volume b943b4fc-bf7b-4939-8acf-eb0245dd681e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:39 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f8dc7e36-732f-4989-9f00-a055384e0021 tempest-VolumesActionsTest-936447654 None] Copy volume to image completed successfully. Nov 03 17:32:39 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e 1073741824 Nov 03 17:32:39 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:39 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e 1073741824" returned: 0 in 0.489s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:39 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e Nov 03 17:32:39 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:40 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.218s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433083045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecede3c0-2ae6-415b-98f9-cf3eac4b6556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:14Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Creating volume ecede3c0-2ae6-415b-98f9-cf3eac4b6556 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:40 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ff08e3-7e86-4c70-8cdf-4167998da347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15b78d1-f670-4740-9095-d9fe5656eca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:40 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 1073741824 Nov 03 17:32:40 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:40 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Volume volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e (b943b4fc-bf7b-4939-8acf-eb0245dd681e): created successfully Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15b78d1-f670-4740-9095-d9fe5656eca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (ec0f07c8-4499-4632-b48a-aaf0281b9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6d810633-7038-42ff-af20-883cc10ff560 tempest-CreateVolumesFromImageTest-696521337 None] Created volume successfully. Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:40 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 1073741824" returned: 0 in 0.472s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:40 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 Nov 03 17:32:40 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:41 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.332s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782153460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699eaff0-da71-4a84-8be1-51475c05a550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:14Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Creating volume 699eaff0-da71-4a84-8be1-51475c05a550 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db27c14-ae92-4f6f-98aa-0132a0554083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:41 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 1073741824 Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23585094-875c-49b0-aba9-c697c0adef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:41 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Volume volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 (ecede3c0-2ae6-415b-98f9-cf3eac4b6556): created successfully Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23585094-875c-49b0-aba9-c697c0adef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (05313ffd-45bc-436f-9b8f-73d29d7fcd8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5825af59-8253-4316-bbfa-198adbdb2b87 tempest-CreateVolumesFromImageTest-696521337 None] Created volume successfully. Nov 03 17:32:41 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 1073741824" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:41 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 Nov 03 17:32:41 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:41 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.199s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886977405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fb6204-dd8c-42c8-8cac-443d5e340317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:15Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Creating volume 10fb6204-dd8c-42c8-8cac-443d5e340317 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9118a5-06de-4627-88b8-04db723cdf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699eaff0-da71-4a84-8be1-51475c05a550', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:41 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 1073741824 Nov 03 17:32:41 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924a4861-0c28-4b75-89bb-d0ac02e6bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Volume volume-699eaff0-da71-4a84-8be1-51475c05a550 (699eaff0-da71-4a84-8be1-51475c05a550): created successfully Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924a4861-0c28-4b75-89bb-d0ac02e6bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (c4d4a5ba-fa95-4351-a8d8-18adb6be5160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-227d7c10-db07-4349-b0c4-0aa459e4a6f5 tempest-CreateVolumesFromImageTest-696521337 None] Created volume successfully. Nov 03 17:32:42 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 1073741824" returned: 0 in 0.516s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:42 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 Nov 03 17:32:42 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:42 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317" returned: 0 in 0.236s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.345s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309753365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7fc06a-f294-4481-91e4-8f04acc39931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eea980be9494370b96b3206aa0378e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:16Z,use_quota=True,user_id='d139a82301b74527b8b2e87a0ca1b908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Creating volume 7c7fc06a-f294-4481-91e4-8f04acc39931 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:42 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:42 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 1073741824 Nov 03 17:32:42 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5376327f-9c6e-4f7c-9bce-6c45b00d06fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fb6204-dd8c-42c8-8cac-443d5e340317', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b982ad-75e6-4571-8201-9cce5d318962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Volume volume-10fb6204-dd8c-42c8-8cac-443d5e340317 (10fb6204-dd8c-42c8-8cac-443d5e340317): created successfully Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b982ad-75e6-4571-8201-9cce5d318962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (0cb45636-107b-4f1c-bed6-aaf7d7abb867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d7de5955-7b69-4bab-919f-6d41a46e9bbf tempest-CreateVolumesFromImageTest-696521337 None] Created volume successfully. Nov 03 17:32:43 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 1073741824" returned: 0 in 0.443s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:43 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 Nov 03 17:32:43 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:43 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.278s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1936358854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd4c85-bdf7-44b9-97ae-d5d24d42443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815abd58aaf4b44ac31bd72a9db2dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:24Z,use_quota=True,user_id='d4049ceaa94947f09b4111d957c50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Creating volume 9ddd4c85-bdf7-44b9-97ae-d5d24d42443f {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:43 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728975c8-c315-4520-b7e6-6a7868bf7210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7fc06a-f294-4481-91e4-8f04acc39931', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fe3c3d-4750-4326-a671-b025647d6a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:43 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f 1073741824 Nov 03 17:32:43 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:43 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Volume volume-7c7fc06a-f294-4481-91e4-8f04acc39931 (7c7fc06a-f294-4481-91e4-8f04acc39931): created successfully Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fe3c3d-4750-4326-a671-b025647d6a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Flow 'volume_create_manager' (c6ac57dc-2bd8-4a35-a8e2-aa9b22728d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d845a762-3cec-4064-a62d-f0d0e4abe5bd tempest-CreateVolumesFromImageTest-696521337 None] Created volume successfully. Nov 03 17:32:43 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f 1073741824" returned: 0 in 0.533s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:44 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f Nov 03 17:32:44 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:44 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.553s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1929286636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9829a2e-c4c2-413e-b3e2-66e7ebba4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3815abd58aaf4b44ac31bd72a9db2dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:32:24Z,use_quota=True,user_id='d4049ceaa94947f09b4111d957c50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Creating volume a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:32:44 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7b7331-8c2b-4ca6-bee6-e9b956295b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4398e7c-f9e7-40a7-a5d7-7f4c20dc2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:44 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 1073741824 Nov 03 17:32:44 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f (9ddd4c85-bdf7-44b9-97ae-d5d24d42443f): created successfully Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4398e7c-f9e7-40a7-a5d7-7f4c20dc2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Flow 'volume_create_manager' (044451e0-f57a-4b75-ae71-6ae641e4890e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-30017d28-f59a-4e3d-bd54-dfed28045cee tempest-TestServerVolumeAttachmentScenario-915167428 None] Created volume successfully. Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-7c7fc06a-f294-4481-91e4-8f04acc39931-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-7c7fc06a-f294-4481-91e4-8f04acc39931-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-quobyte-7c7fc06a-f294-4481-91e4-8f04acc39931" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-7c7fc06a-f294-4481-91e4-8f04acc39931" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23966b3-2725-40ed-890b-1656076aa830]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:44 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 1073741824" returned: 0 in 0.516s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:44 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 Nov 03 17:32:44 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:44 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 Nov 03 17:32:44 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:45 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:45 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" returned: 0 in 0.288s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.397s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:45 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931 Nov 03 17:32:45 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eae9a8-1b60-4ec8-81b1-9d4153f5427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344f826f-1a76-48b2-b9d0-15c8d9d79381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d8279-2215-4c28-95a4-5bafddead897]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Volume volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 (a9829a2e-c4c2-413e-b3e2-66e7ebba4a85): created successfully Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344f826f-1a76-48b2-b9d0-15c8d9d79381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Flow 'volume_create_manager' (618467f6-440d-4e75-b980-42f04eb934b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:32:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2ca134cc-f70f-432c-bca3-3ba6be3bfab4 tempest-TestServerVolumeAttachmentScenario-915167428 None] Created volume successfully. Nov 03 17:32:45 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:45 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:45 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7c7fc06a-f294-4481-91e4-8f04acc39931" returned: 0 in 0.249s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-7c7fc06a-f294-4481-91e4-8f04acc39931" released by "delete_volume" :: held 0.679s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Created reservations ['19e1145b-2029-4afb-8fa7-49a2a8aa8497', 'f43cad45-7559-46f3-9999-b3c32001f63a', '026ef767-2a2a-482f-9144-f46b525bd321', '8bf70fdc-3f40-4a98-96fa-3a306b4ae51b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:45 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:45 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:45 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.426s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97c89d2-33a6-4ecf-81b8-a64baea2666b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:45 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:45 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:45 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Deleted volume successfully. Nov 03 17:32:46 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.464s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:46 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img Nov 03 17:32:46 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a97b6092-2a7e-4042-a83b-232f4dbad0e6 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-7c7fc06a-f294-4481-91e4-8f04acc39931-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-10fb6204-dd8c-42c8-8cac-443d5e340317-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-10fb6204-dd8c-42c8-8cac-443d5e340317-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-quobyte-10fb6204-dd8c-42c8-8cac-443d5e340317" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-10fb6204-dd8c-42c8-8cac-443d5e340317" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0faf15-0446-4cb9-96cc-ca28b19d0306]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:46 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 Nov 03 17:32:46 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:47 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317" returned: 0 in 0.802s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:47 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317 Nov 03 17:32:47 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:47 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-10fb6204-dd8c-42c8-8cac-443d5e340317" returned: 0 in 0.404s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-10fb6204-dd8c-42c8-8cac-443d5e340317" released by "delete_volume" :: held 1.305s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Created reservations ['531b0ce4-dca5-480f-b5b0-62971f31cbdb', '18795a27-3ec8-4694-a728-1f61db1a112e', '16a2a2aa-1530-4ae0-a4fa-d9ed0dcbb59c', 'b7493c41-082a-4315-9a6d-be1bfb96de1a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:47 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:48 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:48 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.491s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Deleted volume successfully. Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-80207506-0702-4bfb-a98b-1caa6e9fb77e tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-10fb6204-dd8c-42c8-8cac-443d5e340317-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-699eaff0-da71-4a84-8be1-51475c05a550-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-699eaff0-da71-4a84-8be1-51475c05a550-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-quobyte-699eaff0-da71-4a84-8be1-51475c05a550" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-699eaff0-da71-4a84-8be1-51475c05a550" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb9df72-b8f7-4712-99f6-d3d780ed1f70]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:48 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 Nov 03 17:32:48 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:49 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550" returned: 0 in 0.648s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:49 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550 Nov 03 17:32:49 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:49 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-699eaff0-da71-4a84-8be1-51475c05a550" returned: 0 in 0.535s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-699eaff0-da71-4a84-8be1-51475c05a550" released by "delete_volume" :: held 1.279s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Created reservations ['4ced7d25-c57b-4c9f-a1ff-bcf5a80e1112', '9a695d7c-061a-4ee4-8dbd-225550817fc3', 'e3cc4696-58a9-4bd2-b4d2-c974335e7dff', '10724d83-4ae1-4db4-b40b-a69cfcf927e9'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:50 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:50 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:50 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.439s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Deleted volume successfully. Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d97380bd-7172-4750-a534-2f01eeb7d3fc tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-699eaff0-da71-4a84-8be1-51475c05a550-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-ecede3c0-2ae6-415b-98f9-cf3eac4b6556-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-ecede3c0-2ae6-415b-98f9-cf3eac4b6556-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-quobyte-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c505c-cadd-4fea-b76b-a42951109127]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:51 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 Nov 03 17:32:51 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:51 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" returned: 0 in 0.610s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:51 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556 Nov 03 17:32:51 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:52 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-ecede3c0-2ae6-415b-98f9-cf3eac4b6556" released by "delete_volume" :: held 1.002s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Created reservations ['a30cece1-4379-46ad-b5cc-c5b85f94eee6', '044dde26-855d-4de4-b796-78763c4c42a5', '010f401a-519f-45f6-9313-b0a65cdeb36c', 'edebaf76-10f8-420f-99fb-f09dcffd75de'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:52 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:52 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:52 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.361s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Deleted volume successfully. Nov 03 17:32:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d5cd4503-b2cf-4ce9-ba6b-2c4d462ebe22 tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-ecede3c0-2ae6-415b-98f9-cf3eac4b6556-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-b943b4fc-bf7b-4939-8acf-eb0245dd681e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-b943b4fc-bf7b-4939-8acf-eb0245dd681e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img" returned: 0 in 7.344s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2515c3-f354-4580-831f-b14707c1bb45]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "cinder-quobyte-b943b4fc-bf7b-4939-8acf-eb0245dd681e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-b943b4fc-bf7b-4939-8acf-eb0245dd681e" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c2f240-39b0-488a-ae53-ff17d1ed1056]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:53 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:53 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:53 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e Nov 03 17:32:53 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:53 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e" returned: 0 in 0.432s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:53 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e Nov 03 17:32:53 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:53 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.569s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:32:53 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Converted 1024.00 MB image at 139.41 MB/s Nov 03 17:32:53 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] ee76e3a5-a032-4cb6-bf39-ee8a1232f3eb was raw, converting to qcow2 {{(pid=86995) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde3bf8-a239-45ca-a683-0eae8f6314f1]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:54 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img Nov 03 17:32:54 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:54 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b943b4fc-bf7b-4939-8acf-eb0245dd681e" returned: 0 in 0.249s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-quobyte-b943b4fc-bf7b-4939-8acf-eb0245dd681e" released by "delete_volume" :: held 0.728s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Created reservations ['e8819340-606d-4a31-adc3-b580763f82be', '22a82443-9d06-4ea1-aad6-295140668652', '348ce6a0-ddc5-4335-a288-d0b822ab300e', '65bb6b41-f091-42cf-8dfb-43068df96e08'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:54 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:54 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:54 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img" returned: 0 in 0.327s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:54 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img Nov 03 17:32:54 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:54 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Deleted volume successfully. Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-738f512d-6a2e-48b8-9495-e6bac257292b tempest-CreateVolumesFromImageTest-696521337 None] Lock "cinder-b943b4fc-bf7b-4939-8acf-eb0245dd681e-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:54 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img" returned: 1 in 0.353s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:54 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg Nov 03 17:32:54 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:54 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Image conversion details: src /opt/stack/data/cinder/conversion/60d16a88-a445-4560-a72e-69b6a520a8a8.temp_image.ee76e3a5-a032-4cb6-bf39-ee8a1232f3ebl0tnywto.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:32:54 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b892b0-1c9c-4de3-985b-3cedc08f8cc2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:55 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg Nov 03 17:32:55 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:55 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ajfy1dg" returned: 0 in 0.381s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.723s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Uploaded volume to glance image-id: ee76e3a5-a032-4cb6-bf39-ee8a1232f3eb. {{(pid=86995) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:32:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3b8f0ef0-f6b9-4dbc-a8ea-b6b50ac1dfeb tempest-VolumesActionsTest-936447654 None] Copy volume to image completed successfully. Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Acquiring lock "cinder-quobyte-60d16a88-a445-4560-a72e-69b6a520a8a8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "cinder-quobyte-60d16a88-a445-4560-a72e-69b6a520a8a8" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9b985-a426-42cc-9774-0c20e928793c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:58 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:58 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-218b8d57-2ae4-4c07-a06d-992ccb374b12 req-dd714215-e193-40e4-bffc-17e7cbc6e597 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-218b8d57-2ae4-4c07-a06d-992ccb374b12 req-dd714215-e193-40e4-bffc-17e7cbc6e597 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-218b8d57-2ae4-4c07-a06d-992ccb374b12 req-dd714215-e193-40e4-bffc-17e7cbc6e597 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-218b8d57-2ae4-4c07-a06d-992ccb374b12 req-dd714215-e193-40e4-bffc-17e7cbc6e597 tempest-TestServerVolumeAttachmentScenario-915167428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '260ea369-58d0-4392-9356-86791aa2d7ed', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:32:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-218b8d57-2ae4-4c07-a06d-992ccb374b12 req-dd714215-e193-40e4-bffc-17e7cbc6e597 tempest-TestServerVolumeAttachmentScenario-915167428 None] attachment_update completed successfully. Nov 03 17:32:58 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:58 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8 Nov 03 17:32:58 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:58 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-60d16a88-a445-4560-a72e-69b6a520a8a8" returned: 0 in 0.284s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "cinder-quobyte-60d16a88-a445-4560-a72e-69b6a520a8a8" released by "delete_volume" :: held 0.725s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Created reservations ['e9d98f50-1920-4694-8909-6b241fe382f2', 'a1d00b35-32cf-4880-919c-d13ea8d750bb', '521d1383-e27c-4644-b973-0ffced1d78bf', '4c609c0b-e997-4097-ac15-22bae5adc633'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:32:59 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:32:59 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:32:59 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:32:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Deleted volume successfully. Nov 03 17:32:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8d5ea221-6e40-4aef-b6b4-7176d2f57713 tempest-VolumesActionsTest-936447654 None] Lock "cinder-60d16a88-a445-4560-a72e-69b6a520a8a8-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Flow 'volume_create_manager' (69eaf0ce-c5a4-4330-bfc3-d992a6370505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9bb578c-e0cd-43c8-8993-53aca6b44936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9bb578c-e0cd-43c8-8993-53aca6b44936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd1b93-0284-4509-a7d1-b10e5d7d09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aaf03b84c24c5d8ae878f7ac1bf655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:00Z,use_quota=True,user_id='03d46fbd3fa04f538a1706c77837fa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db07bf4f-bce9-452f-b874-48750e6c0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db07bf4f-bce9-452f-b874-48750e6c0f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e9456e-848a-4552-a812-9383a6d62f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e9456e-848a-4552-a812-9383a6d62f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dffd1b93-0284-4509-a7d1-b10e5d7d09e0', 'volume_name': 'volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0', 'volume_size': 1, 'image_id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d35a24755ba9b5cfd0660e44c02d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83aaf03b84c24c5d8ae878f7ac1bf655', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538c6037c2e5c0a0e59d232d690e64b6e532d29769f459610e281d4eccb38097a08bec2d1848f0dd2a17ee549e86ab31dbba86c4f81b7c580c85ba4ba98c7b6f', 'id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'created_at': datetime.datetime(2026, 11, 3, 16, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 32, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07f93844-ffe6-4b97-bd83-237c64d32e0c/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc080c8-7c65-4a3a-8c8e-2bd49e526acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc080c8-7c65-4a3a-8c8e-2bd49e526acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5722df-3079-41f0-900e-f999edc9f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:00 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0', 'volume_size': 1, 'image_id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d35a24755ba9b5cfd0660e44c02d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83aaf03b84c24c5d8ae878f7ac1bf655', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538c6037c2e5c0a0e59d232d690e64b6e532d29769f459610e281d4eccb38097a08bec2d1848f0dd2a17ee549e86ab31dbba86c4f81b7c580c85ba4ba98c7b6f', 'id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'created_at': datetime.datetime(2026, 11, 3, 16, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 32, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07f93844-ffe6-4b97-bd83-237c64d32e0c/file', 'properties': {}}, 'image_service': } Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Trying to clone dffd1b93-0284-4509-a7d1-b10e5d7d09e0 from image 07f93844-ffe6-4b97-bd83-237c64d32e0c at location (None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:33:00 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4886d66-fb0b-46c7-b901-55bb202aa752]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:00 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:00 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:01 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:01 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:01 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:01 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Temporary image 07f93844-ffe6-4b97-bd83-237c64d32e0c is fetched for user 03d46fbd3fa04f538a1706c77837fa46. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70f9cc2-f63c-4305-9c49-76d1957b51fe]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:01 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:01 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:01 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:02 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:02 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:02 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd1b93-0284-4509-a7d1-b10e5d7d09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aaf03b84c24c5d8ae878f7ac1bf655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:00Z,use_quota=True,user_id='03d46fbd3fa04f538a1706c77837fa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Creating volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:02 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:02 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1073741824 Nov 03 17:33:02 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:02 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1073741824" returned: 0 in 0.432s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:02 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 Nov 03 17:33:02 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:03 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Attempting download of 07f93844-ffe6-4b97-bd83-237c64d32e0c ((None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}])) to volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0895c3ec-9ea2-4087-9741-601be9b20be6]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:03 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5 Nov 03 17:33:03 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:03 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5" returned: 0 in 0.349s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:03 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5 Nov 03 17:33:03 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:03 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5" returned: 1 in 0.357s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07f93844-ffe6-4b97-bd83-237c64d32e0c_5r071ze5' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[19311543-478d-46b7-ad4b-ae5e288bc261]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:04 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:04 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-678abee1-b0b6-48a0-a8ef-81d485f3a2b7 req-64cd9edc-773c-457d-bbd9-1b4ff75f80ff tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-678abee1-b0b6-48a0-a8ef-81d485f3a2b7 req-64cd9edc-773c-457d-bbd9-1b4ff75f80ff tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-678abee1-b0b6-48a0-a8ef-81d485f3a2b7 req-64cd9edc-773c-457d-bbd9-1b4ff75f80ff tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:04 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-678abee1-b0b6-48a0-a8ef-81d485f3a2b7 req-64cd9edc-773c-457d-bbd9-1b4ff75f80ff tempest-TestServerVolumeAttachmentScenario-915167428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d429cc7-a2ed-42da-ae65-31c77cedbea1', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:33:04 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD Nov 03 17:33:04 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-678abee1-b0b6-48a0-a8ef-81d485f3a2b7 req-64cd9edc-773c-457d-bbd9-1b4ff75f80ff tempest-TestServerVolumeAttachmentScenario-915167428 None] attachment_update completed successfully. Nov 03 17:33:04 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] 07f93844-ffe6-4b97-bd83-237c64d32e0c was raw, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:33:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:04 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 Nov 03 17:33:04 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:05 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" returned: 0 in 0.585s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07f93844-ffe6-4b97-bd83-237c64d32e0c_isjfc_svdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:33:05 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:05 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1G Nov 03 17:33:05 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:05 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 1G" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Downloaded image 07f93844-ffe6-4b97-bd83-237c64d32e0c ((None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}])) to volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Temporary image 07f93844-ffe6-4b97-bd83-237c64d32e0c for user 03d46fbd3fa04f538a1706c77837fa46 is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Marking volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Copying metadata from image 07f93844-ffe6-4b97-bd83-237c64d32e0c to dffd1b93-0284-4509-a7d1-b10e5d7d09e0. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Creating volume glance metadata for volume dffd1b93-0284-4509-a7d1-b10e5d7d09e0 backed by image 07f93844-ffe6-4b97-bd83-237c64d32e0c with: {'image_id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f6d35a24755ba9b5cfd0660e44c02d56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5722df-3079-41f0-900e-f999edc9f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0', 'volume_size': 1, 'image_id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07f93844-ffe6-4b97-bd83-237c64d32e0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d35a24755ba9b5cfd0660e44c02d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83aaf03b84c24c5d8ae878f7ac1bf655', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '538c6037c2e5c0a0e59d232d690e64b6e532d29769f459610e281d4eccb38097a08bec2d1848f0dd2a17ee549e86ab31dbba86c4f81b7c580c85ba4ba98c7b6f', 'id': '07f93844-ffe6-4b97-bd83-237c64d32e0c', 'created_at': datetime.datetime(2026, 11, 3, 16, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 32, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07f93844-ffe6-4b97-bd83-237c64d32e0c/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0749d0ea-5fc8-4d5b-b6a1-ff56ba7668d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:05 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Volume volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 (dffd1b93-0284-4509-a7d1-b10e5d7d09e0): created successfully Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0749d0ea-5fc8-4d5b-b6a1-ff56ba7668d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Flow 'volume_create_manager' (69eaf0ce-c5a4-4330-bfc3-d992a6370505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:05 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4011ffcb-29a7-47e2-ab6f-45db897e077d tempest-VolumeImageDependencyTests-688270839 None] Created volume successfully. Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Acquiring lock "cinder-dffd1b93-0284-4509-a7d1-b10e5d7d09e0-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "cinder-dffd1b93-0284-4509-a7d1-b10e5d7d09e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Acquiring lock "cinder-quobyte-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "cinder-quobyte-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7cd2ab-2185-4f87-a90f-acc0b9304ab9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-d11caf9f-4eda-4133-bbc0-055f59eff704 req-0e1fc21c-5a82-496a-be3e-5e8f15ad4c53 tempest-TestServerVolumeAttachmentScenario-915167428 None] Terminate volume connection completed successfully. Nov 03 17:33:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-d11caf9f-4eda-4133-bbc0-055f59eff704 req-0e1fc21c-5a82-496a-be3e-5e8f15ad4c53 tempest-TestServerVolumeAttachmentScenario-915167428 None] Deleting attachment 3d429cc7-a2ed-42da-ae65-31c77cedbea1. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:33:06 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 Nov 03 17:33:06 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:07 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:07 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0 Nov 03 17:33:07 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:07 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" returned: 0 in 0.250s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "cinder-quobyte-dffd1b93-0284-4509-a7d1-b10e5d7d09e0" released by "delete_volume" :: held 0.702s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Created reservations ['8a2046ba-e40e-486c-b019-0323389c0e95', '833dacb8-b6c9-4e10-abb9-6b3349fb2c86', '2a79b198-f6b1-4163-8e76-6b8dd0e90db0', '83fe9a1c-6746-4666-9dbe-4b5c794f5b6d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:07 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:07 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:08 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.329s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Deleted volume successfully. Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-79a0d0a6-3bb7-41c9-bb42-80a64f60d2b0 tempest-VolumeImageDependencyTests-688270839 None] Lock "cinder-dffd1b93-0284-4509-a7d1-b10e5d7d09e0-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Flow 'volume_create_manager' (cf23526a-51dc-4806-83c1-fd9f110bffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfdb73-bb46-4282-8e56-b57e3f6b8c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfdb73-bb46-4282-8e56-b57e3f6b8c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266283282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83e10aa-f660-4826-b0ba-8ebf6642da82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab321adc1fb0418c8938d355b71552b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:08Z,use_quota=True,user_id='4123ab9df7164fbbae864eb8aecbe183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4eaed9-2f63-43b0-ab3f-c75a725a48b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4eaed9-2f63-43b0-ab3f-c75a725a48b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13767179-5e0c-471e-9ec3-e81a70b40bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13767179-5e0c-471e-9ec3-e81a70b40bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b83e10aa-f660-4826-b0ba-8ebf6642da82', 'volume_name': 'volume-b83e10aa-f660-4826-b0ba-8ebf6642da82', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d225db70-7c59-4a9b-8839-17ee717d3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d225db70-7c59-4a9b-8839-17ee717d3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c61b61-83a8-4e26-9f2b-23e0ed08a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Volume b83e10aa-f660-4826-b0ba-8ebf6642da82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b83e10aa-f660-4826-b0ba-8ebf6642da82', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Trying to clone b83e10aa-f660-4826-b0ba-8ebf6642da82 from image 0146c52b-9712-4e77-91c3-cd4953180efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:33:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-8462a81c-9d8a-495b-81cf-e0577b3ac72b req-f1e2398d-20e1-4418-ab09-b9454906b270 tempest-TestServerVolumeAttachmentScenario-915167428 None] Terminate volume connection completed successfully. Nov 03 17:33:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-8462a81c-9d8a-495b-81cf-e0577b3ac72b req-f1e2398d-20e1-4418-ab09-b9454906b270 tempest-TestServerVolumeAttachmentScenario-915167428 None] Deleting attachment 260ea369-58d0-4392-9356-86791aa2d7ed. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:33:09 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498758f-10ff-4715-931c-75c2e9768230]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:09 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD Nov 03 17:33:09 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:09 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe is fetched for user 4123ab9df7164fbbae864eb8aecbe183. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98c397-bc30-4e9b-976f-58883f8b7508]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:09 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD Nov 03 17:33:09 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:09 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266283282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83e10aa-f660-4826-b0ba-8ebf6642da82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab321adc1fb0418c8938d355b71552b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:08Z,use_quota=True,user_id='4123ab9df7164fbbae864eb8aecbe183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Creating volume b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:09 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:10 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1073741824 Nov 03 17:33:10 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:10 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1073741824" returned: 0 in 0.662s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:10 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 Nov 03 17:33:10 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:10 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Attempting download of 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume b83e10aa-f660-4826-b0ba-8ebf6642da82. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f472f-b987-4ec8-a5ff-25fd26783a21]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:11 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki Nov 03 17:33:11 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:11 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki" returned: 0 in 0.446s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:11 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki Nov 03 17:33:11 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:11 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki" returned: 1 in 0.383s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i075nxki' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8654f7b5-0a65-4b9e-9eed-ba3eb1fe04ad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:12 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD Nov 03 17:33:12 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:12 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:12 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] 0146c52b-9712-4e77-91c3-cd4953180efe was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:33:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:12 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 Nov 03 17:33:12 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Flow 'volume_create_manager' (808614f3-ccd0-41b7-8918-c03664ca2074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d89a1e-6732-4f58-b87d-4dc2daf9ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d89a1e-6732-4f58-b87d-4dc2daf9ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986673004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925f190f-5590-408a-95d2-ea389e9ae349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f1967d1bd40dda352b4d3415878f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:13Z,use_quota=True,user_id='81c8b036c6ca4f999df2155e16ec87db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a173bbd-80ad-44fb-9780-3432fc937335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a173bbd-80ad-44fb-9780-3432fc937335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5021c569-cdb1-42f4-b448-d0f25ebb8722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5021c569-cdb1-42f4-b448-d0f25ebb8722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925f190f-5590-408a-95d2-ea389e9ae349', 'volume_name': 'volume-925f190f-5590-408a-95d2-ea389e9ae349', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce21263-37fc-4c9e-8614-b1d4755c381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce21263-37fc-4c9e-8614-b1d4755c381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06356e-d818-4f54-a94a-f60cb13d5bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:13 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Volume 925f190f-5590-408a-95d2-ea389e9ae349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925f190f-5590-408a-95d2-ea389e9ae349', 'volume_size': 1} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986673004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925f190f-5590-408a-95d2-ea389e9ae349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f1967d1bd40dda352b4d3415878f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:13Z,use_quota=True,user_id='81c8b036c6ca4f999df2155e16ec87db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Creating volume 925f190f-5590-408a-95d2-ea389e9ae349 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:13 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:13 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 1073741824 Nov 03 17:33:13 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "cinder-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "cinder-quobyte-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-quobyte-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee275c-5932-4ef8-bcf8-fe73c736f522]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:13 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 1073741824" returned: 0 in 0.630s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:13 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 Nov 03 17:33:13 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:13 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 Nov 03 17:33:13 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:14 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06356e-d818-4f54-a94a-f60cb13d5bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925f190f-5590-408a-95d2-ea389e9ae349', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe7d48-7762-4012-a0a4-c49aa76f531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Volume volume-925f190f-5590-408a-95d2-ea389e9ae349 (925f190f-5590-408a-95d2-ea389e9ae349): created successfully Nov 03 17:33:14 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe7d48-7762-4012-a0a4-c49aa76f531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Flow 'volume_create_manager' (808614f3-ccd0-41b7-8918-c03664ca2074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" returned: 0 in 0.496s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-643f1123-016c-49a2-babd-c6675dd9e636 tempest-ProjectReaderTests-589149955 None] Created volume successfully. Nov 03 17:33:14 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85 Nov 03 17:33:14 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:14 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82" returned: 0 in 2.162s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_o8lrvng_devstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:33:14 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Converted 112.00 MB image at 51.78 MB/s Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:14 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1G Nov 03 17:33:14 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:14 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" returned: 0 in 0.288s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-quobyte-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85" released by "delete_volume" :: held 0.850s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Created reservations ['40f4ce79-2cff-4da2-9db0-6693f8b9b99c', '191be00d-c90f-4388-bbe9-99a576369de3', 'ba7b8ffd-6388-4887-9724-394703ecf420', 'ecf0ade1-c44f-43d5-bff7-1fac6a74a263'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:14 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:14 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:14 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 1G" returned: 0 in 0.370s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Downloaded image 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume b83e10aa-f660-4826-b0ba-8ebf6642da82 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe for user 4123ab9df7164fbbae864eb8aecbe183 is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Marking volume b83e10aa-f660-4826-b0ba-8ebf6642da82 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "cinder-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Copying metadata from image 0146c52b-9712-4e77-91c3-cd4953180efe to b83e10aa-f660-4826-b0ba-8ebf6642da82. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Creating volume glance metadata for volume b83e10aa-f660-4826-b0ba-8ebf6642da82 backed by image 0146c52b-9712-4e77-91c3-cd4953180efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "cinder-quobyte-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-quobyte-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:14 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c61b61-83a8-4e26-9f2b-23e0ed08a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83e10aa-f660-4826-b0ba-8ebf6642da82', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139ebdbd-074f-4dd3-bb64-183fd7d30d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b434e-8849-40ce-bfd0-6b74070cac64]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Deleted volume successfully. Nov 03 17:33:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Volume volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 (b83e10aa-f660-4826-b0ba-8ebf6642da82): created successfully Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139ebdbd-074f-4dd3-bb64-183fd7d30d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Flow 'volume_create_manager' (cf23526a-51dc-4806-83c1-fd9f110bffaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-36d2efc9-77b8-4ea0-8fe8-e53812999a1e tempest-VolumesExtendTest-1922830486 None] Created volume successfully. Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b7bfc22f-76e6-46f6-986c-f31427f20801 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-a9829a2e-c4c2-413e-b3e2-66e7ebba4a85-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:15 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f Nov 03 17:33:15 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Acquiring lock "cinder-925f190f-5590-408a-95d2-ea389e9ae349-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "cinder-925f190f-5590-408a-95d2-ea389e9ae349-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Acquiring lock "cinder-quobyte-925f190f-5590-408a-95d2-ea389e9ae349" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "cinder-quobyte-925f190f-5590-408a-95d2-ea389e9ae349" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:15 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" returned: 0 in 0.440s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00222d-1aa4-41c0-be06-0ca064b22297]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:15 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f Nov 03 17:33:15 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:15 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 Nov 03 17:33:15 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:15 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-quobyte-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f" released by "delete_volume" :: held 0.772s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Created reservations ['6feda008-e61c-4082-93ff-01756afa546a', '80894d2c-b251-4b13-a860-62d0059e0bab', '522bfada-e5ea-4f1b-b5f4-9c6e0250a4d5', '9fb47245-b227-4be6-a64c-dbd06f97f4c1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:15 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d75be-680f-4360-a342-efcdf7bd7ef8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:15 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349 Nov 03 17:33:15 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:16 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:16 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:16 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 Nov 03 17:33:16 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:16 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-925f190f-5590-408a-95d2-ea389e9ae349" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "cinder-quobyte-925f190f-5590-408a-95d2-ea389e9ae349" released by "delete_volume" :: held 0.804s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:16 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Created reservations ['c0e5ed86-2bad-499f-9347-c1d632bc9848', 'fd773281-2dc0-4a81-9255-dd66bb584f91', 'e2585d01-be7a-4fcc-a8eb-a0abd9ecc20a', '158409ae-90fd-406f-9306-950ce604e74d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.323s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Deleted volume successfully. Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc319e25-6f20-48d8-99ea-bc7fedb7cf38 tempest-TestServerVolumeAttachmentScenario-915167428 None] Lock "cinder-9ddd4c85-bdf7-44b9-97ae-d5d24d42443f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:16 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82" returned: 0 in 0.459s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 2G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:16 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:16 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 2G" returned: 0 in 0.154s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.654s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c13ba1c2-55eb-4d1d-8aa6-b5fa9905746a tempest-VolumesExtendTest-1922830486 None] Extend volume completed successfully. Nov 03 17:33:16 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Deleted volume successfully. Nov 03 17:33:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-012c209d-e3aa-405c-9bdd-4239069310ea tempest-ProjectReaderTests-589149955 None] Lock "cinder-925f190f-5590-408a-95d2-ea389e9ae349-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Flow 'volume_create_manager' (e71ec983-634d-4743-ad34-ea8f2ed4119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddf0614-7651-4ca6-bdfd-d89608a118eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddf0614-7651-4ca6-bdfd-d89608a118eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856376546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f1967d1bd40dda352b4d3415878f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:17Z,use_quota=True,user_id='81c8b036c6ca4f999df2155e16ec87db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a4bbe-2f72-4db8-8c6a-e69b8c8b9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a4bbe-2f72-4db8-8c6a-e69b8c8b9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f44d3ef-79d4-4687-9a34-e7b7662d9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f44d3ef-79d4-4687-9a34-e7b7662d9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf', 'volume_name': 'volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434c632-1057-4296-81a2-a765c7f68818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434c632-1057-4296-81a2-a765c7f68818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093538eb-e2c2-469d-b90e-5258e48d809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Volume 7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf', 'volume_size': 1} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856376546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f1967d1bd40dda352b4d3415878f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:17Z,use_quota=True,user_id='81c8b036c6ca4f999df2155e16ec87db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Creating volume 7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:17 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf 1073741824 Nov 03 17:33:17 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-b83e10aa-f660-4826-b0ba-8ebf6642da82-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-b83e10aa-f660-4826-b0ba-8ebf6642da82-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-quobyte-b83e10aa-f660-4826-b0ba-8ebf6642da82" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-b83e10aa-f660-4826-b0ba-8ebf6642da82" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d61c44-f4b1-45df-a2b6-4c1fd0518e2c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:17 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 Nov 03 17:33:17 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:17 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf 1073741824" returned: 0 in 0.550s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:17 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf Nov 03 17:33:17 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:17 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:17 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82 Nov 03 17:33:17 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:17 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093538eb-e2c2-469d-b90e-5258e48d809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8489db5f-6003-49cb-849c-1bb02f63f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Volume volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf (7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf): created successfully Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8489db5f-6003-49cb-849c-1bb02f63f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Flow 'volume_create_manager' (e71ec983-634d-4743-ad34-ea8f2ed4119f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-efcddb0c-b4f7-4ad1-91d3-bbdc353198f8 tempest-ProjectReaderTests-589149955 None] Created volume successfully. Nov 03 17:33:18 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b83e10aa-f660-4826-b0ba-8ebf6642da82" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-b83e10aa-f660-4826-b0ba-8ebf6642da82" released by "delete_volume" :: held 0.753s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Created reservations ['c2f8d1a8-dbeb-4843-a5c0-4ecec0d842f2', '6f8758f1-b57e-4ea7-aafe-cf5a24958748', 'f4f285ef-36dd-4245-a5b4-1fc4dee7c4f1', '096e9263-3a51-49cf-bd49-0b6c76e9bf95'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:18 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:18 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:18 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Deleted volume successfully. Nov 03 17:33:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e25712cd-dee2-4282-9826-37d90817c71d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-b83e10aa-f660-4826-b0ba-8ebf6642da82-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Flow 'volume_create_manager' (eb259cae-c7b0-4ed6-a01c-00540e4e0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9322e31d-806a-48d7-b477-7b9390257460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9322e31d-806a-48d7-b477-7b9390257460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2039444581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483d87d0-70eb-49d6-a5cd-4051c31e9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab321adc1fb0418c8938d355b71552b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:19Z,use_quota=True,user_id='4123ab9df7164fbbae864eb8aecbe183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2828f2-787d-4893-8395-6a0ce8ed5d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2828f2-787d-4893-8395-6a0ce8ed5d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8c61e9-71ab-4750-abb8-d18fceaeb845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8c61e9-71ab-4750-abb8-d18fceaeb845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483d87d0-70eb-49d6-a5cd-4051c31e9f23', 'volume_name': 'volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c3c01b-2fda-450a-a547-0e899f4351fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c3c01b-2fda-450a-a547-0e899f4351fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3606700-ef76-4bb3-9084-3ac3218cae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Volume 483d87d0-70eb-49d6-a5cd-4051c31e9f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23', 'volume_size': 1} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2039444581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483d87d0-70eb-49d6-a5cd-4051c31e9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab321adc1fb0418c8938d355b71552b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:19Z,use_quota=True,user_id='4123ab9df7164fbbae864eb8aecbe183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Creating volume 483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:19 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:19 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 1073741824 Nov 03 17:33:19 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Acquiring lock "cinder-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "cinder-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Acquiring lock "cinder-quobyte-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "cinder-quobyte-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18f12ea-2ec7-4793-8ecb-1b71094394d8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:19 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf Nov 03 17:33:19 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:19 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 1073741824" returned: 0 in 0.456s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:19 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:19 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:19 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:19 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf Nov 03 17:33:19 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:19 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3606700-ef76-4bb3-9084-3ac3218cae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5769a250-8c3d-44a5-bddb-71e691a241b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:20 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Volume volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 (483d87d0-70eb-49d6-a5cd-4051c31e9f23): created successfully Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5769a250-8c3d-44a5-bddb-71e691a241b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Flow 'volume_create_manager' (eb259cae-c7b0-4ed6-a01c-00540e4e0db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "cinder-quobyte-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf" released by "delete_volume" :: held 0.792s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-16f803e2-707a-478b-bcee-247452e3b5ae tempest-VolumesExtendTest-1922830486 None] Created volume successfully. Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Created reservations ['8197ad38-c1dd-4812-bc49-01b501580257', '7118fdc7-0b21-4994-a01a-2e150e03c0cd', '88ef2edd-982d-406a-8a0b-690132ad1df7', 'd352d466-de13-47be-83bb-983e62b47c29'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:20 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:20 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:20 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Deleted volume successfully. Nov 03 17:33:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f9d1f75a-79d5-4f1c-9cd3-5f727a60e900 tempest-ProjectReaderTests-589149955 None] Lock "cinder-7a5a12fb-49b0-40b0-a3a7-e9295d9d3eaf-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Creating offline snapshot 6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 of volume 483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33df1d3-434a-4c4e-9886-ede06691faf0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:21 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:21 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:21 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.449s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:21 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 1G Nov 03 17:33:21 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:22 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 1G" returned: 0 in 0.437s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:22 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 Nov 03 17:33:22 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:22 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" returned: 0 in 0.326s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:22 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 is being set with open permissions: ugo+rw Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:22 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 Nov 03 17:33:22 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:22 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:23 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info Nov 03 17:33:23 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:23 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info" returned: 0 in 0.279s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:23 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info is being set with open permissions: ugo+rw Nov 03 17:33:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:23 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info Nov 03 17:33:23 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:23 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.info" returned: 0 in 0.276s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9459f1f1-8b9b-4a2c-86b2-16b7049387ac tempest-VolumesExtendTest-1922830486 None] Create snapshot completed successfully Nov 03 17:33:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2da591-7922-43fd-94ef-007954edef62]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:24 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:24 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:25 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.487s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 2G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 2G" returned: 0 in 0.179s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.729s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:25 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-eddf548b-b036-4445-bd6e-a069f6bf5521 tempest-VolumesExtendTest-1922830486 None] Extend volume completed successfully. Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-quobyte-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Deleting offline snapshot 6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 of volume 483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] snapshot_file for this snap is: volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f3db40-9cf9-4ee0-b4c4-fe71d65ebe43]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:26 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 Nov 03 17:33:26 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:26 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" returned: 0 in 0.407s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[03461f3a-6e07-46f1-818b-20d921d12954]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:26 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:26 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:27 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.429s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:27 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 Nov 03 17:33:27 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:27 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" returned: 0 in 0.498s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:27 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11 Nov 03 17:33:27 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:27 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23.6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11" released by "_delete_snapshot" :: held 1.812s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" released by "delete_snapshot" :: held 1.839s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:27 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Created reservations ['d6b3da57-ad1a-4941-a374-56097d3b7c57', '0d9d2ec9-47e3-478f-acd8-b3d7d2c38a31', '8e31a023-b8d7-477f-b03c-44a52a09a86a', 'a7f45049-2fe4-4e48-8c10-a7caa4f2afac'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Delete snapshot completed successfully. Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-580bf415-e7b9-42e3-8811-5917b380931d tempest-VolumesExtendTest-1922830486 None] Lock "cinder-6526a0bd-9cb7-4f15-8ade-c1d944a0fc11-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-483d87d0-70eb-49d6-a5cd-4051c31e9f23-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "cinder-483d87d0-70eb-49d6-a5cd-4051c31e9f23-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Acquiring lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b44d01f-716e-4377-ba73-5727ed8b6d80]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:28 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:28 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:28 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:28 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23 Nov 03 17:33:28 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:29 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-483d87d0-70eb-49d6-a5cd-4051c31e9f23" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "cinder-quobyte-483d87d0-70eb-49d6-a5cd-4051c31e9f23" released by "delete_volume" :: held 0.731s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Created reservations ['f4008fbc-a776-4778-b631-e684107ec2c8', '4e7ca378-f524-4528-bb82-d8211d45b2dd', '37bb91be-e5a0-4bb3-a1c1-5ee0fe6665af', '70a8dc7f-b03b-4ed6-bcec-5acef19d9f9b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:29 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:29 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (854e7e67-481f-4fcf-9f33-432728f551b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4499f68-5a50-4020-a189-7b6156501ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4499f68-5a50-4020-a189-7b6156501ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1279333841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6160e14-8798-409b-9d14-14dbcf46c94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:29Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c10c68-535e-4a36-911b-c1d99a2367c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c10c68-535e-4a36-911b-c1d99a2367c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feebbac-1a0e-472f-ade1-44a014658444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feebbac-1a0e-472f-ade1-44a014658444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6160e14-8798-409b-9d14-14dbcf46c94c', 'volume_name': 'volume-e6160e14-8798-409b-9d14-14dbcf46c94c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2af70b-9fa1-4dc5-b4dd-f3cd7a1eb3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2af70b-9fa1-4dc5-b4dd-f3cd7a1eb3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ff6a98-67f2-40b4-97de-d2affd906b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume e6160e14-8798-409b-9d14-14dbcf46c94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6160e14-8798-409b-9d14-14dbcf46c94c', 'volume_size': 1} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1279333841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6160e14-8798-409b-9d14-14dbcf46c94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:29Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:29 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:29 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:29 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Deleted volume successfully. Nov 03 17:33:29 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c 1073741824 Nov 03 17:33:29 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5df7403c-eedc-4c52-b69d-8a3fac936936 tempest-VolumesExtendTest-1922830486 None] Lock "cinder-483d87d0-70eb-49d6-a5cd-4051c31e9f23-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:30 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c 1073741824" returned: 0 in 0.491s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:30 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c Nov 03 17:33:30 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:30 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ff6a98-67f2-40b4-97de-d2affd906b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6160e14-8798-409b-9d14-14dbcf46c94c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cfc5c0-4f3c-4e9a-a652-f36b262055b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-e6160e14-8798-409b-9d14-14dbcf46c94c (e6160e14-8798-409b-9d14-14dbcf46c94c): created successfully Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cfc5c0-4f3c-4e9a-a652-f36b262055b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (854e7e67-481f-4fcf-9f33-432728f551b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-008758e8-fb30-496f-8720-284fcc4b8d53 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating offline snapshot 922e7a8d-d696-4149-b533-11a5314a131c of volume e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:33:31 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[38267bb8-a7f7-4477-ab10-c9ebf1efbcc4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:31 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c Nov 03 17:33:31 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:32 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:32 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c 1G Nov 03 17:33:32 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:32 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c 1G" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6160e14-8798-409b-9d14-14dbcf46c94c -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:32 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6160e14-8798-409b-9d14-14dbcf46c94c -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c Nov 03 17:33:32 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:32 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6160e14-8798-409b-9d14-14dbcf46c94c -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c" returned: 0 in 0.318s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:32 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c is being set with open permissions: ugo+rw Nov 03 17:33:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:32 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c Nov 03 17:33:32 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:33 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (b39ad768-6c0d-406b-8252-9ebdb2e418de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be873f5e-a85c-46ce-9480-c6fccc1498c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c" returned: 0 in 0.290s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be873f5e-a85c-46ce-9480-c6fccc1498c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1657247191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0aa2c9-81a5-47ed-b829-ec8b795ddb04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:33Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27382320-94f9-439d-8343-7b2debe9c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27382320-94f9-439d-8343-7b2debe9c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a087f7c1-4da8-428b-b6cb-978f2eff1f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a087f7c1-4da8-428b-b6cb-978f2eff1f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0aa2c9-81a5-47ed-b829-ec8b795ddb04', 'volume_name': 'volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a2438-ed7e-40af-a487-147bff5184fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a2438-ed7e-40af-a487-147bff5184fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821c2600-f6e4-45b8-b640-20df6d29001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:33 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Volume 4f0aa2c9-81a5-47ed-b829-ec8b795ddb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04', 'volume_size': 1} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:33 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info Nov 03 17:33:33 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:33 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info" returned: 0 in 0.239s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:33 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info is being set with open permissions: ugo+rw Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:33 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info Nov 03 17:33:33 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:33 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.info" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1657247191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0aa2c9-81a5-47ed-b829-ec8b795ddb04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:33Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Creating volume 4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:33 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:33 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 1073741824 Nov 03 17:33:33 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6347f1b0-6435-46dd-b274-21a38d4dd05b tempest-CreateVolumesFromSnapshotTest-697356647 None] Create snapshot completed successfully Nov 03 17:33:34 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 1073741824" returned: 0 in 0.422s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:34 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 Nov 03 17:33:34 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:34 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" returned: 0 in 0.234s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821c2600-f6e4-45b8-b640-20df6d29001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c4791-5a61-46f5-8469-c1b1b3388193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:34 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Volume volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 (4f0aa2c9-81a5-47ed-b829-ec8b795ddb04): created successfully Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c4791-5a61-46f5-8469-c1b1b3388193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:34 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (b39ad768-6c0d-406b-8252-9ebdb2e418de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-37003a2c-7764-41ce-aeaa-a7a9afc21f8a tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=161,cinder:SELECT=130,cinder:INSERT=48,cinder:DELETE=11 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=135,cinder:UPDATE=166,cinder:DELETE=18,cinder:INSERT=46 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (db1b1020-4fee-4cc4-b984-5fc8e6ab84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949b5b48-27bc-44c1-a7fc-8b43d61947c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949b5b48-27bc-44c1-a7fc-8b43d61947c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798337753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db36c084-7596-4969-888f-8bc0e8a1dfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:35Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d87e0e5-2c69-4b9f-baec-40819d92daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d87e0e5-2c69-4b9f-baec-40819d92daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39064aa7-6584-4669-9fd2-85220cf8e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39064aa7-6584-4669-9fd2-85220cf8e85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db36c084-7596-4969-888f-8bc0e8a1dfcf', 'volume_name': 'volume-db36c084-7596-4969-888f-8bc0e8a1dfcf', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24d51db-b540-4b3f-9e54-9aa50e33852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24d51db-b540-4b3f-9e54-9aa50e33852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd674d-509f-4f9d-8a40-7ac930b1712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume db36c084-7596-4969-888f-8bc0e8a1dfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db36c084-7596-4969-888f-8bc0e8a1dfcf', 'volume_size': 1} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798337753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db36c084-7596-4969-888f-8bc0e8a1dfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:35Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume db36c084-7596-4969-888f-8bc0e8a1dfcf {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:35 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:35 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf 1073741824 Nov 03 17:33:35 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (cf675426-b31e-4885-8050-6aa863e24585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d102c2d-d81e-4ca2-bdde-ca64cb9460b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d102c2d-d81e-4ca2-bdde-ca64cb9460b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828967461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2102d8a-0fba-4798-9c66-6e7744c31344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65da81f4-72dd-44d0-a4e4-519329dd9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65da81f4-72dd-44d0-a4e4-519329dd9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235ef4a3-0cbf-4893-8168-d268cab76479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235ef4a3-0cbf-4893-8168-d268cab76479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2102d8a-0fba-4798-9c66-6e7744c31344', 'volume_name': 'volume-c2102d8a-0fba-4798-9c66-6e7744c31344', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2cbc8e-6514-49cb-b27c-5e8e70a0143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2cbc8e-6514-49cb-b27c-5e8e70a0143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2310f3f0-85a5-4231-ad70-5a8cc4576220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume c2102d8a-0fba-4798-9c66-6e7744c31344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2102d8a-0fba-4798-9c66-6e7744c31344', 'volume_size': 1} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf 1073741824" returned: 0 in 0.586s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:36 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf Nov 03 17:33:36 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (4a9c711c-43cb-4283-ae93-24d9755a7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28aea67c-0bcb-430e-b1cf-d9a3b0031cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828967461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2102d8a-0fba-4798-9c66-6e7744c31344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume c2102d8a-0fba-4798-9c66-6e7744c31344 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28aea67c-0bcb-430e-b1cf-d9a3b0031cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1908225974',display_name='tempest-VolumesGetTest-Volume-452287499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14851acd-8b5e-4422-82f5-c8322a81322b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7879ff-08e5-46e4-ba86-062db128bf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 1073741824 Nov 03 17:33:36 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7879ff-08e5-46e4-ba86-062db128bf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a777e0e-c8fc-4e23-9591-b85dc841dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a777e0e-c8fc-4e23-9591-b85dc841dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14851acd-8b5e-4422-82f5-c8322a81322b', 'volume_name': 'volume-14851acd-8b5e-4422-82f5-c8322a81322b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d269a036-1444-4b10-a0b4-30ed396683f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d269a036-1444-4b10-a0b4-30ed396683f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dde3e20-e81b-437c-a19b-5e638a9943fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Volume 14851acd-8b5e-4422-82f5-c8322a81322b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14851acd-8b5e-4422-82f5-c8322a81322b', 'volume_size': 1} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd674d-509f-4f9d-8a40-7ac930b1712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db36c084-7596-4969-888f-8bc0e8a1dfcf', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29f55eb-beda-4c9e-b527-b9228c30989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (5ea77f2c-6bb3-4953-99a1-99c38a95ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e87dbd-7e9e-4226-91ca-35f3a0793315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e87dbd-7e9e-4226-91ca-35f3a0793315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468414538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27657512-ba6a-441d-8124-75cc7cc7b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92827b7-92ef-4a56-b1ff-7214f4a9c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92827b7-92ef-4a56-b1ff-7214f4a9c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11004760-e7cf-4335-9ba5-3de5ac884a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11004760-e7cf-4335-9ba5-3de5ac884a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27657512-ba6a-441d-8124-75cc7cc7b98c', 'volume_name': 'volume-27657512-ba6a-441d-8124-75cc7cc7b98c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb780f8-d4d8-41c0-ae3f-f06b98320186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb780f8-d4d8-41c0-ae3f-f06b98320186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9618df-5c5b-4eeb-86b8-df302e63ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume 27657512-ba6a-441d-8124-75cc7cc7b98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27657512-ba6a-441d-8124-75cc7cc7b98c', 'volume_size': 1} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-db36c084-7596-4969-888f-8bc0e8a1dfcf (db36c084-7596-4969-888f-8bc0e8a1dfcf): created successfully Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29f55eb-beda-4c9e-b527-b9228c30989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (db1b1020-4fee-4cc4-b984-5fc8e6ab84dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1bec9d20-b43e-47b9-a8c4-7788b89e8bbe tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (c4c10788-55e4-4ead-81f4-5a0e60d59f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27d966e-b114-44ba-b634-8dfd0480420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27d966e-b114-44ba-b634-8dfd0480420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652201617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f430b0a-6283-4564-8c0e-b28780015cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:37Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24610f94-ac7c-44a2-ad7f-c3c122c77b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24610f94-ac7c-44a2-ad7f-c3c122c77b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8db527-fedf-49b2-a609-105d6cf1ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8db527-fedf-49b2-a609-105d6cf1ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f430b0a-6283-4564-8c0e-b28780015cef', 'volume_name': 'volume-3f430b0a-6283-4564-8c0e-b28780015cef', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7be40a-3835-400e-8bf4-5b8adba280ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7be40a-3835-400e-8bf4-5b8adba280ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf470f9b-dcee-48ec-8869-e9eaaf90684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume 3f430b0a-6283-4564-8c0e-b28780015cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f430b0a-6283-4564-8c0e-b28780015cef', 'volume_size': 1} Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:36 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 1073741824" returned: 0 in 0.550s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (9fbe8757-f613-449a-84e4-72a9d266eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6652d5-3ad3-4555-bd18-0115f65b9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6652d5-3ad3-4555-bd18-0115f65b9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116289652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822fac86-81c9-4934-9683-c8547ed08a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:37Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcd2751-cda5-447a-9554-a6f50820e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 Nov 03 17:33:37 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcd2751-cda5-447a-9554-a6f50820e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a61b36-3071-42c2-b62f-8dffb52a7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a61b36-3071-42c2-b62f-8dffb52a7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822fac86-81c9-4934-9683-c8547ed08a32', 'volume_name': 'volume-822fac86-81c9-4934-9683-c8547ed08a32', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553de50-2b1e-464d-ae61-9c94d6de821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553de50-2b1e-464d-ae61-9c94d6de821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282821ea-2292-49c4-8e90-bdc78cb92c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume 822fac86-81c9-4934-9683-c8547ed08a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822fac86-81c9-4934-9683-c8547ed08a32', 'volume_size': 1} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:37 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1908225974',display_name='tempest-VolumesGetTest-Volume-452287499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14851acd-8b5e-4422-82f5-c8322a81322b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Creating volume 14851acd-8b5e-4422-82f5-c8322a81322b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:37 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2310f3f0-85a5-4231-ad70-5a8cc4576220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2102d8a-0fba-4798-9c66-6e7744c31344', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b 1073741824 Nov 03 17:33:37 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8a5a01-19ab-40c9-986b-ecc0b7f5f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:37 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-c2102d8a-0fba-4798-9c66-6e7744c31344 (c2102d8a-0fba-4798-9c66-6e7744c31344): created successfully Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8a5a01-19ab-40c9-986b-ecc0b7f5f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (cf675426-b31e-4885-8050-6aa863e24585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bf18370c-8a55-4dc9-babb-4db7e5021009 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:37 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b 1073741824" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:37 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b Nov 03 17:33:37 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:38 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b" returned: 0 in 0.246s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468414538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27657512-ba6a-441d-8124-75cc7cc7b98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:36Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume 27657512-ba6a-441d-8124-75cc7cc7b98c {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dde3e20-e81b-437c-a19b-5e638a9943fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14851acd-8b5e-4422-82f5-c8322a81322b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:38 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c 1073741824 Nov 03 17:33:38 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557304b2-0ba9-4d91-aabb-278f61fb0959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Volume volume-14851acd-8b5e-4422-82f5-c8322a81322b (14851acd-8b5e-4422-82f5-c8322a81322b): created successfully Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557304b2-0ba9-4d91-aabb-278f61fb0959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (4a9c711c-43cb-4283-ae93-24d9755a7db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e14d3834-ed6c-43e2-94d7-0fa4df4ceeb0 tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:33:38 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c 1073741824" returned: 0 in 0.399s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:38 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c Nov 03 17:33:38 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:38 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652201617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f430b0a-6283-4564-8c0e-b28780015cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:37Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume 3f430b0a-6283-4564-8c0e-b28780015cef {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:38 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef 1073741824 Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9618df-5c5b-4eeb-86b8-df302e63ae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27657512-ba6a-441d-8124-75cc7cc7b98c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:38 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24cb5f-d0e8-4611-94aa-468a814c1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-27657512-ba6a-441d-8124-75cc7cc7b98c (27657512-ba6a-441d-8124-75cc7cc7b98c): created successfully Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24cb5f-d0e8-4611-94aa-468a814c1872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (5ea77f2c-6bb3-4953-99a1-99c38a95ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4a7e5087-e1c9-42b9-acb0-1b584988b35f tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:38 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:38 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:39 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:33:39 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef 1073741824" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:39 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef Nov 03 17:33:39 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-14851acd-8b5e-4422-82f5-c8322a81322b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "cinder-14851acd-8b5e-4422-82f5-c8322a81322b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-14851acd-8b5e-4422-82f5-c8322a81322b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-14851acd-8b5e-4422-82f5-c8322a81322b" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61e574-c494-4ef2-9f17-197990ddc211]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:39 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116289652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822fac86-81c9-4934-9683-c8547ed08a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f791b386bf274c50ac61fb79e00e9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:37Z,use_quota=True,user_id='d4dec4adbb304949a60c59c327354e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Creating volume 822fac86-81c9-4934-9683-c8547ed08a32 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:39 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:39 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 1073741824 Nov 03 17:33:39 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf470f9b-dcee-48ec-8869-e9eaaf90684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f430b0a-6283-4564-8c0e-b28780015cef', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89fb4e0-fbdb-4540-a0b2-0ba9c0c045f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:39 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-3f430b0a-6283-4564-8c0e-b28780015cef (3f430b0a-6283-4564-8c0e-b28780015cef): created successfully Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89fb4e0-fbdb-4540-a0b2-0ba9c0c045f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (c4c10788-55e4-4ead-81f4-5a0e60d59f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:39 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b Nov 03 17:33:39 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5046af69-bf88-48c8-b61f-43bcee11e6b6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:39 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b" returned: 0 in 0.385s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:39 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b Nov 03 17:33:39 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:39 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 1073741824" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:40 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 Nov 03 17:33:40 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:40 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-14851acd-8b5e-4422-82f5-c8322a81322b" returned: 0 in 0.260s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-14851acd-8b5e-4422-82f5-c8322a81322b" released by "delete_volume" :: held 0.692s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Created reservations ['d5319f97-b188-4c0c-8bdc-61d4b1c866ee', 'e052648f-ea43-4f4c-a2c6-ab5fe87f2370', 'e861eb14-2c19-48e4-83ec-cf2af39c4321', '0a99a697-b0cf-432d-bec4-928c4a5b6323'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:40 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282821ea-2292-49c4-8e90-bdc78cb92c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822fac86-81c9-4934-9683-c8547ed08a32', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4108f7-5158-4585-adad-ee9cf9ebb19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:40 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:40 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:40 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Volume volume-822fac86-81c9-4934-9683-c8547ed08a32 (822fac86-81c9-4934-9683-c8547ed08a32): created successfully Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4108f7-5158-4585-adad-ee9cf9ebb19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Flow 'volume_create_manager' (9fbe8757-f613-449a-84e4-72a9d266eed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-44da1712-2ad0-4f52-bfa4-a0eaaddc6c84 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created volume successfully. Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-822fac86-81c9-4934-9683-c8547ed08a32-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-822fac86-81c9-4934-9683-c8547ed08a32-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-822fac86-81c9-4934-9683-c8547ed08a32" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-822fac86-81c9-4934-9683-c8547ed08a32" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:40 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.297s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba9a73f-23dc-4e2a-b3d6-c6ecb316e8cc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-612b0dd2-33b5-4107-bb08-8e4781eb4d09 tempest-VolumesGetTest-966370328 None] Lock "cinder-14851acd-8b5e-4422-82f5-c8322a81322b-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "cinder-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:40 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 Nov 03 17:33:40 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a70a90-ac11-4340-b117-461ac3b81cb3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:40 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 Nov 03 17:33:40 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:40 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32" returned: 0 in 0.373s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:40 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32 Nov 03 17:33:40 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:41 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" returned: 0 in 0.410s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:41 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04 Nov 03 17:33:41 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:41 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-822fac86-81c9-4934-9683-c8547ed08a32" returned: 0 in 0.284s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-822fac86-81c9-4934-9683-c8547ed08a32" released by "delete_volume" :: held 0.705s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['a948359a-4373-43d0-9784-67ee27ec6f73', 'c1f2d0ca-31f8-4681-94c9-7731a040d08f', 'c4f46dfe-1c46-44ca-ad4a-7ad89e53e3fd', '94428b4b-8288-4d2d-9b50-df62bb9f4907'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:41 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04" released by "delete_volume" :: held 0.728s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:41 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:41 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Created reservations ['218c90ee-ed3c-4d2d-901f-486cc5cf20b5', '6555507f-ba92-447c-994f-90fce2e7e05e', 'b6d49881-b869-434b-9a6a-6f2c9c7f9f2f', 'a8caa721-3d12-4f29-bc2d-b2de719eeefe'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:41 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:41 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-3f430b0a-6283-4564-8c0e-b28780015cef-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-3f430b0a-6283-4564-8c0e-b28780015cef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:41 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-3f430b0a-6283-4564-8c0e-b28780015cef" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-122a8dc7-5faa-4436-ad18-0b85c1260d64 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-822fac86-81c9-4934-9683-c8547ed08a32-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-3f430b0a-6283-4564-8c0e-b28780015cef" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[4687316b-88aa-4cdb-9b2d-8b7151dd2c1e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:41 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:33:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-90d2707a-a10b-4cd9-937f-bf6b45f11e68 tempest-VolumesGetTest-966370328 None] Lock "cinder-4f0aa2c9-81a5-47ed-b829-ec8b795ddb04-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:41 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef Nov 03 17:33:41 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:42 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef" returned: 0 in 0.383s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:42 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef Nov 03 17:33:42 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (2e61ea71-dbee-494e-8e6d-9fe9d48c2e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd0aa40-160e-4a1f-8e7d-40b4895f9572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:42 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3f430b0a-6283-4564-8c0e-b28780015cef" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd0aa40-160e-4a1f-8e7d-40b4895f9572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19918709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:42Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed15110-85c0-4916-b7ba-f23dae1b533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed15110-85c0-4916-b7ba-f23dae1b533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afb132-bc9b-4eb8-a2ba-719560a13dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afb132-bc9b-4eb8-a2ba-719560a13dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'volume_name': 'volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536e132a-90fc-4023-8b04-499b5ba0989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536e132a-90fc-4023-8b04-499b5ba0989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f155602a-6959-4aa7-b401-5fbb5ceeb3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Volume 878db4ce-b3b3-48df-9ec2-cc643f6dcfe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'volume_size': 1} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19918709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:42Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Creating volume 878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:42 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-3f430b0a-6283-4564-8c0e-b28780015cef" released by "delete_volume" :: held 0.772s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:42 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 1073741824 Nov 03 17:33:42 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['d3ee60b8-578e-47cc-9702-cff6c69c892d', '3a06dfc5-1018-4b46-bb5a-e40c4ef9f6d1', 'dfa19adf-3774-48ae-94f9-dcef01f4123c', 'feb36df7-159b-4e5e-b47a-47a79a302d65'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:42 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:42 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-27657512-ba6a-441d-8124-75cc7cc7b98c-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-27657512-ba6a-441d-8124-75cc7cc7b98c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-27657512-ba6a-441d-8124-75cc7cc7b98c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-27657512-ba6a-441d-8124-75cc7cc7b98c" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93eb4e1-36ed-4aaa-b219-dc869c771a3c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:42 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.301s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-89b90995-7419-444c-ab42-c28fd6bf76a6 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-3f430b0a-6283-4564-8c0e-b28780015cef-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:42 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 1073741824" returned: 0 in 0.508s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:43 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c Nov 03 17:33:43 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:33:43 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:43 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:43 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.251s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f155602a-6959-4aa7-b401-5fbb5ceeb3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b021b0-8daa-42f6-8f35-32d68236865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:43 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:43 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Volume volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 (878db4ce-b3b3-48df-9ec2-cc643f6dcfe8): created successfully Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b021b0-8daa-42f6-8f35-32d68236865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (2e61ea71-dbee-494e-8e6d-9fe9d48c2e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c" returned: 0 in 0.392s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e85c0708-1737-4b75-9020-18de1de973ba tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:33:43 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c Nov 03 17:33:43 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:43 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27657512-ba6a-441d-8124-75cc7cc7b98c" returned: 0 in 0.230s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-27657512-ba6a-441d-8124-75cc7cc7b98c" released by "delete_volume" :: held 0.670s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['64c801d2-2ace-4031-a4ec-c8b2d2eeda40', '88713380-e559-4fb1-b6f3-6f17d1d51436', 'bd4a5e6d-74fd-4d55-b56d-5fab6c3aeb08', '9a5f9335-60a4-4e47-b43d-c119f2664ee1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:43 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:43 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:43 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.227s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bae8d4e2-072a-48a7-ac85-592c5e0ad321 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-27657512-ba6a-441d-8124-75cc7cc7b98c-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-c2102d8a-0fba-4798-9c66-6e7744c31344-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-c2102d8a-0fba-4798-9c66-6e7744c31344-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-c2102d8a-0fba-4798-9c66-6e7744c31344" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-c2102d8a-0fba-4798-9c66-6e7744c31344" acquired by "delete_volume" :: waited 0.012s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d86aec-bade-4457-94ef-600db4666f44]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:44 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 Nov 03 17:33:44 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:44 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344" returned: 0 in 0.353s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:44 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344 Nov 03 17:33:44 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:44 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c2102d8a-0fba-4798-9c66-6e7744c31344" returned: 0 in 0.248s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-c2102d8a-0fba-4798-9c66-6e7744c31344" released by "delete_volume" :: held 0.640s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['0a79e150-c445-4520-9e2d-677116c2a622', 'ee711d81-e36d-4cec-9311-57014f4a3309', '4612ebcf-1c80-4314-9adf-84eb997a277a', 'c598b239-1263-4fa7-9176-47f50044c580'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (8fd97a33-f889-4ba6-a67f-2e3ee7bf9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a14ed0-9783-4155-add1-ee92b79d88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a14ed0-9783-4155-add1-ee92b79d88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1743853764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc8a05-5022-4fa8-83c7-4de400e03b8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:45Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c48ce-3147-41d3-92fd-46a5d51ec248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c48ce-3147-41d3-92fd-46a5d51ec248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a3e80-5f66-49e9-a49f-0abbec5c93e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:44 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:44 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a3e80-5f66-49e9-a49f-0abbec5c93e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cebc8a05-5022-4fa8-83c7-4de400e03b8b', 'volume_name': 'volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b', 'volume_size': 1, 'source_volid': '878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'source_volstatus': 'available'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9ca383-a2b4-4e93-8aca-40aff162aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9ca383-a2b4-4e93-8aca-40aff162aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91043e8f-3c39-4d35-bfe9-1fb22e9671a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Volume cebc8a05-5022-4fa8-83c7-4de400e03b8b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b', 'volume_size': 1, 'source_volid': '878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'source_volstatus': 'available'} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:44 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Cloning volume 878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 to volume cebc8a05-5022-4fa8-83c7-4de400e03b8b Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Creating offline snapshot 3ba7a96b-3646-402c-8095-cdef0a9899fe of volume 878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c3d44-9c48-4091-842c-64d14e7fc485]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:45 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:33:45 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:45 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.255s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de9c74eb-060a-4e66-86dd-7eb8ac9b2e40 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-c2102d8a-0fba-4798-9c66-6e7744c31344-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-db36c084-7596-4969-888f-8bc0e8a1dfcf-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-db36c084-7596-4969-888f-8bc0e8a1dfcf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-db36c084-7596-4969-888f-8bc0e8a1dfcf" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-db36c084-7596-4969-888f-8bc0e8a1dfcf" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fa9e7d-9d9c-4890-aaec-b985cb99b149]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:45 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf Nov 03 17:33:45 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:45 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.407s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:45 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe 1G Nov 03 17:33:45 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:45 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf" returned: 0 in 0.354s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:45 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf Nov 03 17:33:45 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:45 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe 1G" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:45 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:45 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:45 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-db36c084-7596-4969-888f-8bc0e8a1dfcf" returned: 0 in 0.247s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-db36c084-7596-4969-888f-8bc0e8a1dfcf" released by "delete_volume" :: held 0.644s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['4bef125a-d0b3-448f-a0a6-eca3ac4e0f9f', 'b02a0e4f-0a50-4c11-8872-467761de79bd', 'd6162369-9aa4-4377-85a8-56d462ac0220', '3e610f8d-9d98-4210-a30f-da9c1ae5abc6'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:46 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe is being set with open permissions: ugo+rw Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:46 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.289s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-922e7a8d-d696-4149-b533-11a5314a131c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1263094-7573-4b96-baaa-0f629ea7cafa tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-db36c084-7596-4969-888f-8bc0e8a1dfcf-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-922e7a8d-d696-4149-b533-11a5314a131c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:46 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-922e7a8d-d696-4149-b533-11a5314a131c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-922e7a8d-d696-4149-b533-11a5314a131c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleting offline snapshot 922e7a8d-d696-4149-b533-11a5314a131c of volume e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] snapshot_file for this snap is: volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a7958d-077f-4022-92c7-1eb57858d22f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info Nov 03 17:33:46 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c Nov 03 17:33:46 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info is being set with open permissions: ugo+rw Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info Nov 03 17:33:46 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c" returned: 0 in 0.379s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6160e14-8798-409b-9d14-14dbcf46c94c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0753a8cd-2f74-41be-a781-1bc805dd205a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:46 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.info" returned: 0 in 0.253s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:46 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c Nov 03 17:33:46 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] snapshot: 3ba7a96b-3646-402c-8095-cdef0a9899fe, volume: cebc8a05-5022-4fa8-83c7-4de400e03b8b, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad0f07-0c1f-4520-ae6c-3ccc6ddb5a13]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:47 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:47 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:47 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:47 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c Nov 03 17:33:47 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:47 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.360s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f7be2-91fc-49e9-b7c7-8f4f7e4c5fad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:47 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:33:47 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:47 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c" returned: 0 in 0.340s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:47 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c Nov 03 17:33:47 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:47 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.423s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:33:47 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c.922e7a8d-d696-4149-b533-11a5314a131c" returned: 0 in 0.263s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:47 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b Nov 03 17:33:47 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-922e7a8d-d696-4149-b533-11a5314a131c" released by "_delete_snapshot" :: held 1.469s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" released by "delete_snapshot" :: held 1.500s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:47 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['ce62f635-309e-4a64-acbb-c99d1a7c7080', 'b2b408cf-8269-4c72-8b09-8bdf94a79e48', 'dc646819-fc66-4416-a2b9-38034fc1277d', '46810903-033d-4d96-a292-32ee05c52b42'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Delete snapshot completed successfully. Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-f1fd5f9a-04f7-460d-b339-6f83444b6c01 tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-922e7a8d-d696-4149-b533-11a5314a131c-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-e6160e14-8798-409b-9d14-14dbcf46c94c-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-e6160e14-8798-409b-9d14-14dbcf46c94c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276adf9-8998-4a38-aab7-e583ce8ca2e4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:49 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c Nov 03 17:33:49 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:49 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c" returned: 0 in 0.553s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:49 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c Nov 03 17:33:49 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:49 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e6160e14-8798-409b-9d14-14dbcf46c94c" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-quobyte-e6160e14-8798-409b-9d14-14dbcf46c94c" released by "delete_volume" :: held 1.008s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Created reservations ['3768982c-b5fc-49bb-aa05-53fa038bcd14', 'f2ff3fd9-b2aa-4487-86a4-7ff40399ada0', '999090d9-8ca6-4a8c-9790-c8755a098295', '314b088a-5b4c-42cc-b405-3e33e28a44cc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:50 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:50 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:50 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.530s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Deleted volume successfully. Nov 03 17:33:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5ef553eb-ed13-4695-9177-2697f4ae257a tempest-CreateVolumesFromSnapshotTest-697356647 None] Lock "cinder-e6160e14-8798-409b-9d14-14dbcf46c94c-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:54 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b" returned: 0 in 6.797s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:33:54 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Converted 1024.00 MB image at 150.64 MB/s Nov 03 17:33:54 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b is being set with open permissions: ugo+rw Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:54 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b Nov 03 17:33:54 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:54 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" released by "_copy_volume_from_snapshot" :: held 7.914s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-3ba7a96b-3646-402c-8095-cdef0a9899fe" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-3ba7a96b-3646-402c-8095-cdef0a9899fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Deleting offline snapshot 3ba7a96b-3646-402c-8095-cdef0a9899fe of volume 878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] snapshot_file for this snap is: volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91698a0-c790-40fb-bda7-dc5507f94065]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:55 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:55 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Flow 'volume_create_manager' (54bc383a-c3a3-49d3-94a2-741f59dddeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b0fff-f5ec-41b0-bf57-6095625dc84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b0fff-f5ec-41b0-bf57-6095625dc84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146971538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b649d4-7d99-4bcb-85c9-234fdddcb2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27beeed2ed204d2fa93e6cf60a337f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:55Z,use_quota=True,user_id='0221590989044482a3e8566f34325a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41ea4ba-7c0b-486c-a026-d51afca6af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41ea4ba-7c0b-486c-a026-d51afca6af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c10b8c8-65fb-490b-9e80-9be3c351e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c10b8c8-65fb-490b-9e80-9be3c351e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b649d4-7d99-4bcb-85c9-234fdddcb2dc', 'volume_name': 'volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f497865b-c4e9-4c6c-87c6-9e97441bb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f497865b-c4e9-4c6c-87c6-9e97441bb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c452536-b659-4e4a-a792-c68c68ca84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Volume b6b649d4-7d99-4bcb-85c9-234fdddcb2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc', 'volume_size': 1} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:55 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc0f88-b4a6-4501-be9f-b7c71971a479]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:55 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:33:55 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:55 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:55 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:55 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:56 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.321s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:56 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe Nov 03 17:33:56 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:56 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8.3ba7a96b-3646-402c-8095-cdef0a9899fe" returned: 0 in 0.244s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-3ba7a96b-3646-402c-8095-cdef0a9899fe" released by "_delete_snapshot" :: held 1.558s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.596s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146971538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b649d4-7d99-4bcb-85c9-234fdddcb2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27beeed2ed204d2fa93e6cf60a337f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:55Z,use_quota=True,user_id='0221590989044482a3e8566f34325a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Creating volume b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:56 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:56 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc 1073741824 Nov 03 17:33:56 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91043e8f-3c39-4d35-bfe9-1fb22e9671a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b', 'volume_size': 1, 'source_volid': '878db4ce-b3b3-48df-9ec2-cc643f6dcfe8', 'source_volstatus': 'available'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af84032-406e-4b62-87c7-d6143e228afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Volume volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b (cebc8a05-5022-4fa8-83c7-4de400e03b8b): created successfully Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af84032-406e-4b62-87c7-d6143e228afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (8fd97a33-f889-4ba6-a67f-2e3ee7bf9a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-41184b53-5ce2-4e73-9265-0c982a0d03f8 tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:33:56 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc 1073741824" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:57 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:33:57 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:57 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.307s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c452536-b659-4e4a-a792-c68c68ca84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac1c320-3353-4a86-9dd3-adf59f9bce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Volume volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc (b6b649d4-7d99-4bcb-85c9-234fdddcb2dc): created successfully Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac1c320-3353-4a86-9dd3-adf59f9bce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Flow 'volume_create_manager' (54bc383a-c3a3-49d3-94a2-741f59dddeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6768136d-5e44-4f87-89f9-72763405aaf8 tempest-VolumeDependencyTests-709772120 None] Created volume successfully. Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (74d08785-1eac-4c1c-8bf3-acab224c0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf9a829-ff2f-4be7-aabd-be58d3353995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf9a829-ff2f-4be7-aabd-be58d3353995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567143874',display_name='tempest-VolumesGetTest-Volume-1784667649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e663ee7-065d-44bb-8868-f963d82446f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:57Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58001c0e-764f-455c-894c-c4cb1da31b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58001c0e-764f-455c-894c-c4cb1da31b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbd4668-3f59-44d7-bfda-1fc3f416f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbd4668-3f59-44d7-bfda-1fc3f416f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e663ee7-065d-44bb-8868-f963d82446f7', 'volume_name': 'volume-8e663ee7-065d-44bb-8868-f963d82446f7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67c129f-a912-46a6-a553-7a68cccae775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67c129f-a912-46a6-a553-7a68cccae775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f18c05-2182-4ba2-8c2a-205597137614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Volume 8e663ee7-065d-44bb-8868-f963d82446f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e663ee7-065d-44bb-8868-f963d82446f7', 'volume_size': 1} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:33:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567143874',display_name='tempest-VolumesGetTest-Volume-1784667649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e663ee7-065d-44bb-8868-f963d82446f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:33:57Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Creating volume 8e663ee7-065d-44bb-8868-f963d82446f7 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:33:57 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:57 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 1073741824 Nov 03 17:33:57 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:57 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 1073741824" returned: 0 in 0.409s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:58 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 Nov 03 17:33:58 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:58 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f18c05-2182-4ba2-8c2a-205597137614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e663ee7-065d-44bb-8868-f963d82446f7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5b9a26-9276-4ff2-a8b2-53024cb67f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:33:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Volume volume-8e663ee7-065d-44bb-8868-f963d82446f7 (8e663ee7-065d-44bb-8868-f963d82446f7): created successfully Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5b9a26-9276-4ff2-a8b2-53024cb67f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (74d08785-1eac-4c1c-8bf3-acab224c0804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:33:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4ddd8197-7143-4edc-802d-dae834667791 tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Creating offline snapshot 68f48eb1-dc1d-43f4-86e5-9300351481f1 of volume b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701dc4f-1785-4ec7-a0cd-1e3345b821de]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-8e663ee7-065d-44bb-8868-f963d82446f7-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "cinder-8e663ee7-065d-44bb-8868-f963d82446f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-8e663ee7-065d-44bb-8868-f963d82446f7" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:58 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-8e663ee7-065d-44bb-8868-f963d82446f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:58 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb904837-b14a-4dc0-9449-aa8bccb50b5a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:58 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 Nov 03 17:33:58 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:58 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.392s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:59 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 1G Nov 03 17:33:59 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:59 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7" returned: 0 in 0.385s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:59 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7 Nov 03 17:33:59 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:59 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e663ee7-065d-44bb-8868-f963d82446f7" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 1G" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-8e663ee7-065d-44bb-8868-f963d82446f7" released by "delete_volume" :: held 0.708s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:59 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:33:59 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Created reservations ['61235ad0-5df8-4ab2-9a5c-cf1e3987833c', 'c03e8b67-9a65-42a8-aa05-abf435fcab47', '6b5e545b-d67c-415c-85f8-a3d0cd932347', 'c27fd64b-8ac8-4c9c-9628-9da37bc55532'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:59 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:33:59 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:59 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 is being set with open permissions: ugo+rw Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:33:59 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:33:59 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:33:59 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:33:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-802022f4-6884-436a-80e0-bba889421310 tempest-VolumesGetTest-966370328 None] Lock "cinder-8e663ee7-065d-44bb-8868-f963d82446f7-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-cebc8a05-5022-4fa8-83c7-4de400e03b8b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "cinder-cebc8a05-5022-4fa8-83c7-4de400e03b8b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd6b651-c63f-4017-8de7-92f245d024ec]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:33:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:00 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:00 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info Nov 03 17:34:00 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:00 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b Nov 03 17:34:00 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:00 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:00 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info is being set with open permissions: ugo+rw Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:00 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info Nov 03 17:34:00 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:00 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b" returned: 0 in 0.375s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:00 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b Nov 03 17:34:00 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:00 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.info" returned: 0 in 0.247s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cd6709f8-66e8-4403-83a4-9b9de8b1a20d tempest-VolumeDependencyTests-709772120 None] Create snapshot completed successfully Nov 03 17:34:00 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-cebc8a05-5022-4fa8-83c7-4de400e03b8b" returned: 0 in 0.280s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-cebc8a05-5022-4fa8-83c7-4de400e03b8b" released by "delete_volume" :: held 0.705s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Created reservations ['4ea48d6b-7048-46a0-b75e-44cf18f95ea8', 'f43dc0ac-6835-4b18-b59b-51b12a6b672d', 'ca9f7b61-1e18-4bd8-a0b5-405c03e3a481', 'fa02487b-cfd5-4d82-a93d-13b76ebb19ca'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:00 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:00 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:01 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.235s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-de8e0750-4254-49f0-a7ae-d984f42a3750 tempest-VolumesGetTest-966370328 None] Lock "cinder-cebc8a05-5022-4fa8-83c7-4de400e03b8b-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "cinder-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b2636e-22f5-4434-9b91-83ff5684776a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:01 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:34:01 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:01 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.346s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:01 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8 Nov 03 17:34:01 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:01 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" returned: 0 in 0.255s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8" released by "delete_volume" :: held 0.664s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Created reservations ['22e8303e-1a88-4b24-9855-5589cb5aa267', '284dd91f-96d9-47c5-9fee-78c89e3b1bdb', '6aba06d9-0bff-498b-b54f-7448a750eaa3', '9b3cb5b1-e497-4103-b0ca-6b38dab95251'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:01 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:01 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:02 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9769bda2-07a9-482d-8b92-5df11eeae9fb tempest-VolumesGetTest-966370328 None] Lock "cinder-878db4ce-b3b3-48df-9ec2-cc643f6dcfe8-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Flow 'volume_create_manager' (e760f9d9-4258-423f-b687-d843d86f87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533e95a-ded3-41e2-a1d4-666baf4e4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533e95a-ded3-41e2-a1d4-666baf4e4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-869564217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b4884c-95fe-44aa-85f4-1087625f8e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27beeed2ed204d2fa93e6cf60a337f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68f48eb1-dc1d-43f4-86e5-9300351481f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:02Z,use_quota=True,user_id='0221590989044482a3e8566f34325a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399fd29a-5a41-4794-97ef-154cdcece5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399fd29a-5a41-4794-97ef-154cdcece5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e8e0e-87a0-4d50-a3b8-86843528fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e8e0e-87a0-4d50-a3b8-86843528fade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37b4884c-95fe-44aa-85f4-1087625f8e11', 'volume_name': 'volume-37b4884c-95fe-44aa-85f4-1087625f8e11', 'volume_size': 1, 'snapshot_id': '68f48eb1-dc1d-43f4-86e5-9300351481f1'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b1478d-e9d9-4c82-b7c4-578ae7836fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b1478d-e9d9-4c82-b7c4-578ae7836fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b6bf68-af8f-4009-949f-8c158e7dbf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Volume 37b4884c-95fe-44aa-85f4-1087625f8e11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37b4884c-95fe-44aa-85f4-1087625f8e11', 'volume_size': 1, 'snapshot_id': '68f48eb1-dc1d-43f4-86e5-9300351481f1'} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1-37b4884c-95fe-44aa-85f4-1087625f8e11" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1-37b4884c-95fe-44aa-85f4-1087625f8e11" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Creating volume 37b4884c-95fe-44aa-85f4-1087625f8e11 from snapshot 68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] snapshot: 68f48eb1-dc1d-43f4-86e5-9300351481f1, volume: 37b4884c-95fe-44aa-85f4-1087625f8e11, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe69dd1-742e-4cba-85a1-1c38404c1ed5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:02 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:34:02 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:02 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.382s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db81301-14fd-451e-8458-c0df97e1811e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (a5a78831-d2d8-4dec-a94b-14706099c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad6fff2-b1ac-41ea-b594-939b47af57c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:34:02 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad6fff2-b1ac-41ea-b594-939b47af57c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-758647336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03c1c9-3de0-4ef7-8394-77da7cfe150d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:03Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbf7834-f65d-4048-a6e2-ae6ed1d95e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbf7834-f65d-4048-a6e2-ae6ed1d95e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f947d050-8982-40e5-8bd2-5fcb8eac5889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:34:03 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.374s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:03 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 Nov 03 17:34:03 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f947d050-8982-40e5-8bd2-5fcb8eac5889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c03c1c9-3de0-4ef7-8394-77da7cfe150d', 'volume_name': 'volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef89ce8-89fd-4b6d-9c26-14cbbb53cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef89ce8-89fd-4b6d-9c26-14cbbb53cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f0f450-4e31-4551-9b6f-eeae3aa69562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:03 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Trying to clone 1c03c1c9-3de0-4ef7-8394-77da7cfe150d from image 0146c52b-9712-4e77-91c3-cd4953180efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:34:03 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[426708c0-adc2-4c3c-b92b-1e02a0499e88]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:03 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD Nov 03 17:34:03 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:04 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe is fetched for user cfe5b11d4fe4474c95fe97a6521e358c. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6fcd8-32d2-468f-9e2a-d765cda4461f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:04 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD Nov 03 17:34:04 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:04 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:09 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11" returned: 0 in 5.808s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:34:09 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Converted 1024.00 MB image at 176.29 MB/s Nov 03 17:34:09 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 is being set with open permissions: ugo+rw Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:09 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 Nov 03 17:34:09 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:09 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11" returned: 0 in 0.232s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" released by "_copy_volume_from_snapshot" :: held 6.893s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1-37b4884c-95fe-44aa-85f4-1087625f8e11" released by "_create_volume_from_snapshot" :: held 6.963s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.980s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-758647336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03c1c9-3de0-4ef7-8394-77da7cfe150d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:03Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Creating volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:09 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:09 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1073741824 Nov 03 17:34:09 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b6bf68-af8f-4009-949f-8c158e7dbf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b4884c-95fe-44aa-85f4-1087625f8e11', 'volume_size': 1, 'snapshot_id': '68f48eb1-dc1d-43f4-86e5-9300351481f1'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27772112-c3eb-473d-9dea-9adf5413e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:09 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Volume volume-37b4884c-95fe-44aa-85f4-1087625f8e11 (37b4884c-95fe-44aa-85f4-1087625f8e11): created successfully Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27772112-c3eb-473d-9dea-9adf5413e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Flow 'volume_create_manager' (e760f9d9-4258-423f-b687-d843d86f87c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-04b5a138-9a82-493e-8448-eb0b3cd65c48 tempest-VolumeDependencyTests-709772120 None] Created volume successfully. Nov 03 17:34:09 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1073741824" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:09 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d Nov 03 17:34:09 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-68f48eb1-dc1d-43f4-86e5-9300351481f1-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-68f48eb1-dc1d-43f4-86e5-9300351481f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Deleting offline snapshot 68f48eb1-dc1d-43f4-86e5-9300351481f1 of volume b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] snapshot_file for this snap is: volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b0173-185f-48cf-b6fa-9d1d72902e97]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:34:10 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:10 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" returned: 0 in 0.243s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Attempting download of 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec97904a-ae62-40d7-b260-54824fec24d6]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc Nov 03 17:34:10 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:10 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e068bf-2c60-49b0-81e1-182ea0df8fb9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:34:10 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:10 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc" returned: 0 in 0.328s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc Nov 03 17:34:10 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:10 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc" returned: 1 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_i3y5xptc' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[315eb7a9-8df5-4136-8702-5c70ecc1cd54]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.533s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:10 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:34:10 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:10 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD Nov 03 17:34:10 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:11 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] 0146c52b-9712-4e77-91c3-cd4953180efe was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:11 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d Nov 03 17:34:11 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:11 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.315s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:11 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1 Nov 03 17:34:11 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:11 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc.68f48eb1-dc1d-43f4-86e5-9300351481f1" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-68f48eb1-dc1d-43f4-86e5-9300351481f1" released by "_delete_snapshot" :: held 1.618s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" released by "delete_snapshot" :: held 1.644s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Created reservations ['35424c6b-04f3-4d94-89e0-50ab433120fc', '705b63be-8966-4a4d-8de3-5bb2aad8a696', '80f8f719-9ebd-4b10-864b-b47e5485bd20', '2ccaa6fc-60c9-4037-8e8c-6d01afa06811'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Delete snapshot completed successfully. Nov 03 17:34:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-216cdebe-3170-46d3-af18-c043733a6ba1 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-68f48eb1-dc1d-43f4-86e5-9300351481f1-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fdb385-4b30-4cb5-b7fe-4ce1747fd208]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:12 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:34:12 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:12 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.376s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:12 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc Nov 03 17:34:12 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:12 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" returned: 0 in 0.280s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc" released by "delete_volume" :: held 0.733s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Created reservations ['6e5a6337-739f-4c68-b40c-d1bae4e59da1', 'a0b33cbc-d787-477f-9a3c-de191905a39f', 'a8337864-f0d5-48a9-98fa-aeae9884dd22', 'bdaefe62-6536-42c9-b9af-7fbab12d42c2'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:13 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:13 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:13 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" returned: 0 in 1.901s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_vaomzy1sdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:34:13 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Converted 112.00 MB image at 58.85 MB/s Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:13 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1G Nov 03 17:34:13 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-37b4884c-95fe-44aa-85f4-1087625f8e11-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-37b4884c-95fe-44aa-85f4-1087625f8e11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:13 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.293s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:13 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Deleted volume successfully. Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b20efb51-94bb-4a3c-b44b-c4c708e78be2 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-b6b649d4-7d99-4bcb-85c9-234fdddcb2dc-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe78b828-dcf0-4ba0-985a-30a450883c07]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:13 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d 1G" returned: 0 in 0.381s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Downloaded image 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe for user cfe5b11d4fe4474c95fe97a6521e358c is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Marking volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Copying metadata from image 0146c52b-9712-4e77-91c3-cd4953180efe to 1c03c1c9-3de0-4ef7-8394-77da7cfe150d. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Creating volume glance metadata for volume 1c03c1c9-3de0-4ef7-8394-77da7cfe150d backed by image 0146c52b-9712-4e77-91c3-cd4953180efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:34:13 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 Nov 03 17:34:13 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f0f450-4e31-4551-9b6f-eeae3aa69562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd6cfc1-1ddd-4d44-bbe8-f8b0ca294e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:13 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Volume volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d (1c03c1c9-3de0-4ef7-8394-77da7cfe150d): created successfully Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd6cfc1-1ddd-4d44-bbe8-f8b0ca294e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (a5a78831-d2d8-4dec-a94b-14706099c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:13 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-da4ea122-c1d9-494b-b8ef-2fc86383a55b tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:34:13 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:13 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11 Nov 03 17:34:13 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:14 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-37b4884c-95fe-44aa-85f4-1087625f8e11" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-quobyte-37b4884c-95fe-44aa-85f4-1087625f8e11" released by "delete_volume" :: held 0.695s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Created reservations ['cade77d8-eac0-486f-8358-a92d8fd318f9', '43b595da-dfb5-4b73-acf4-9146fcebe416', '7b910eba-1a06-4c13-9063-62c9c70722f3', '9106db61-e811-47b4-8e2c-dc0955861f83'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:14 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:14 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:14 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Deleted volume successfully. Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d4de3a4f-9bba-4f82-9537-c1d17ffb8b66 tempest-VolumeDependencyTests-709772120 None] Lock "cinder-37b4884c-95fe-44aa-85f4-1087625f8e11-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (c6430cc7-f9d3-4fdb-9587-851498c954f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd936842-7e38-48b0-b76b-51a3c16a8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd936842-7e38-48b0-b76b-51a3c16a8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612619458',display_name='tempest-VolumesGetTest-Volume-1173582872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416c2788-884d-41c3-8001-40b1a48d3238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:14Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04a4428-6122-4b8f-88e7-941efb9a461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04a4428-6122-4b8f-88e7-941efb9a461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca6c2cd-2ab7-4002-b067-cecee702bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca6c2cd-2ab7-4002-b067-cecee702bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416c2788-884d-41c3-8001-40b1a48d3238', 'volume_name': 'volume-416c2788-884d-41c3-8001-40b1a48d3238', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c552013-3256-4964-a324-0b370f5e76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c552013-3256-4964-a324-0b370f5e76b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cd871f-9455-4399-87e7-9d9bacad843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:14 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Volume 416c2788-884d-41c3-8001-40b1a48d3238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416c2788-884d-41c3-8001-40b1a48d3238', 'volume_size': 1} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612619458',display_name='tempest-VolumesGetTest-Volume-1173582872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416c2788-884d-41c3-8001-40b1a48d3238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07530bcc8f8c437590acb4fd99541bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:14Z,use_quota=True,user_id='cfe5b11d4fe4474c95fe97a6521e358c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Creating volume 416c2788-884d-41c3-8001-40b1a48d3238 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:14 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:14 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 1073741824 Nov 03 17:34:14 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:14 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 1073741824" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:15 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 Nov 03 17:34:15 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:15 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cd871f-9455-4399-87e7-9d9bacad843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416c2788-884d-41c3-8001-40b1a48d3238', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9638e684-18f2-4595-a844-88cc1caa62dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Volume volume-416c2788-884d-41c3-8001-40b1a48d3238 (416c2788-884d-41c3-8001-40b1a48d3238): created successfully Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9638e684-18f2-4595-a844-88cc1caa62dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Flow 'volume_create_manager' (c6430cc7-f9d3-4fdb-9587-851498c954f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:15 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-dbe90743-ebbb-4ca8-946b-f73c3aee31fb tempest-VolumesGetTest-966370328 None] Created volume successfully. Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-416c2788-884d-41c3-8001-40b1a48d3238-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "cinder-416c2788-884d-41c3-8001-40b1a48d3238-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-416c2788-884d-41c3-8001-40b1a48d3238" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-416c2788-884d-41c3-8001-40b1a48d3238" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d17736e-b25b-4f88-ae2a-ef12b206aa9a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:16 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 Nov 03 17:34:16 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:17 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238" returned: 0 in 0.401s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:17 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238 Nov 03 17:34:17 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Flow 'volume_create_manager' (b55994c0-4ecf-428f-ad96-43816c8abee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b52dc-6404-407d-ac82-0d177e95cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b52dc-6404-407d-ac82-0d177e95cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712aec12a393492c9d19566d0b5ce29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:17Z,use_quota=True,user_id='7192536747fe49edaf1697d303fe8ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978f9b60-26bb-4b78-a4e1-995d81fa9e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978f9b60-26bb-4b78-a4e1-995d81fa9e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02f810a-2e4c-4304-b776-f58edaabd560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02f810a-2e4c-4304-b776-f58edaabd560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5', 'volume_name': 'volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93bbf71-f8cd-4103-ad17-c894fc3fb7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:17 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93bbf71-f8cd-4103-ad17-c894fc3fb7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c29acfa-69a8-4368-9826-16e13e4349a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Volume a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5', 'volume_size': 1} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712aec12a393492c9d19566d0b5ce29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:17Z,use_quota=True,user_id='7192536747fe49edaf1697d303fe8ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Creating volume a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-416c2788-884d-41c3-8001-40b1a48d3238" returned: 0 in 0.299s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:17 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 1073741824 Nov 03 17:34:17 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-416c2788-884d-41c3-8001-40b1a48d3238" released by "delete_volume" :: held 0.752s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Created reservations ['c1a6b770-a19a-4809-a201-ad7b9f97e116', '5c6178cf-6ef7-404b-916b-deffc4dede9b', 'ab4eebd9-f30a-471f-9b80-7ce1697acdb3', '77a226f2-f7c0-4ced-9bb7-af186b5598d0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:17 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:17 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:17 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:34:17 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-1c03c1c9-3de0-4ef7-8394-77da7cfe150d-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 1073741824" returned: 0 in 0.463s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "cinder-1c03c1c9-3de0-4ef7-8394-77da7cfe150d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1e5c15b-243b-4c84-a67d-736faf5de960 tempest-VolumesGetTest-966370328 None] Lock "cinder-416c2788-884d-41c3-8001-40b1a48d3238-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Acquiring lock "cinder-quobyte-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:17 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 Nov 03 17:34:17 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d8eb5-38bb-4366-b716-b4a87e70f573]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:18 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d Nov 03 17:34:18 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:18 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" returned: 0 in 0.246s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c29acfa-69a8-4368-9826-16e13e4349a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62424f67-9345-4b81-8308-68ab1436447a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Volume volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 (a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5): created successfully Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62424f67-9345-4b81-8308-68ab1436447a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Flow 'volume_create_manager' (b55994c0-4ecf-428f-ad96-43816c8abee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c63ed5ad-6927-41d2-bec7-397c654492dc tempest-CinderUnicodeTest-295527770 None] Created volume successfully. Nov 03 17:34:18 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" returned: 0 in 0.355s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:18 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d Nov 03 17:34:18 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:18 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" returned: 0 in 0.242s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "cinder-quobyte-1c03c1c9-3de0-4ef7-8394-77da7cfe150d" released by "delete_volume" :: held 0.641s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Created reservations ['91e932f8-1b29-423e-9ab8-83b900cbee53', '28269d2c-c3f5-4eed-ab01-92e0616d3c62', 'b77b0799-2e95-4a5e-bb75-ed710e163bc5', '55080213-338c-42ad-be8a-7d876a2f73b4'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:18 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:18 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:18 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.235s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:18 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Deleted volume successfully. Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9b31ce94-f900-41ce-a9a5-06851e167179 tempest-VolumesGetTest-966370328 None] Lock "cinder-1c03c1c9-3de0-4ef7-8394-77da7cfe150d-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Flow 'volume_create_manager' (8eed4860-798d-4d9b-8b5a-2b836f4b2384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a08da6-38b8-47e1-a0af-fdd0032edb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a08da6-38b8-47e1-a0af-fdd0032edb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-918304600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c964b652-bb41-439f-83ec-2052c193a9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712aec12a393492c9d19566d0b5ce29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:20Z,use_quota=True,user_id='7192536747fe49edaf1697d303fe8ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780a1345-a6bc-4928-b5cc-7432fa1bc38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780a1345-a6bc-4928-b5cc-7432fa1bc38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb955789-a78b-4007-bd29-11fe56a287b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb955789-a78b-4007-bd29-11fe56a287b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c964b652-bb41-439f-83ec-2052c193a9bd', 'volume_name': 'volume-c964b652-bb41-439f-83ec-2052c193a9bd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a1e741-8ed4-4727-b65f-6319e02df274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a1e741-8ed4-4727-b65f-6319e02df274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a29476-05c5-446f-ac62-a7ff0f0d25d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Volume c964b652-bb41-439f-83ec-2052c193a9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c964b652-bb41-439f-83ec-2052c193a9bd', 'volume_size': 1} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-918304600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c964b652-bb41-439f-83ec-2052c193a9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712aec12a393492c9d19566d0b5ce29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:20Z,use_quota=True,user_id='7192536747fe49edaf1697d303fe8ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Creating volume c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:20 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:20 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd 1073741824 Nov 03 17:34:20 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:20 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd 1073741824" returned: 0 in 0.490s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:20 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd Nov 03 17:34:20 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:20 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd" returned: 0 in 0.259s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a29476-05c5-446f-ac62-a7ff0f0d25d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c964b652-bb41-439f-83ec-2052c193a9bd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593a6e0d-fcfa-4e01-8ef4-d87a946e7db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Volume volume-c964b652-bb41-439f-83ec-2052c193a9bd (c964b652-bb41-439f-83ec-2052c193a9bd): created successfully Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593a6e0d-fcfa-4e01-8ef4-d87a946e7db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Flow 'volume_create_manager' (8eed4860-798d-4d9b-8b5a-2b836f4b2384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a2cc58a7-f285-4c56-9d61-3771dfe3a9ba tempest-CinderUnicodeTest-295527770 None] Created volume successfully. Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Creating offline snapshot 829c528f-4071-4d2a-931e-874e417628d5 of volume c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a307da-0e33-478a-98f5-44e48385b2bc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:22 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd Nov 03 17:34:22 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:22 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd" returned: 0 in 0.368s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:22 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 1G Nov 03 17:34:22 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:23 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 1G" returned: 0 in 0.434s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c964b652-bb41-439f-83ec-2052c193a9bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:23 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c964b652-bb41-439f-83ec-2052c193a9bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 Nov 03 17:34:23 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:23 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c964b652-bb41-439f-83ec-2052c193a9bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:23 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 is being set with open permissions: ugo+rw Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:23 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 Nov 03 17:34:23 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:23 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:23 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info Nov 03 17:34:23 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:23 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:23 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info is being set with open permissions: ugo+rw Nov 03 17:34:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:23 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info Nov 03 17:34:23 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:24 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.info" returned: 0 in 0.231s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:24 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-17aae3fb-2ee0-4423-9a59-f1bab5b26ab4 tempest-CinderUnicodeTest-295527770 None] Create snapshot completed successfully Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-829c528f-4071-4d2a-931e-874e417628d5-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-829c528f-4071-4d2a-931e-874e417628d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-quobyte-829c528f-4071-4d2a-931e-874e417628d5" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-829c528f-4071-4d2a-931e-874e417628d5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Deleting offline snapshot 829c528f-4071-4d2a-931e-874e417628d5 of volume c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] snapshot_file for this snap is: volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e8b4b0-9e36-481f-afe8-9ade06347ae5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:24 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 Nov 03 17:34:24 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:24 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5" returned: 0 in 0.379s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c964b652-bb41-439f-83ec-2052c193a9bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bbde73-c9a5-40a7-a382-a0e773e24416]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:25 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd Nov 03 17:34:25 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:25 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:25 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 Nov 03 17:34:25 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:25 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Flow 'volume_create_manager' (fc33286f-4e77-41db-a52d-6bbff71eb473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f9405c-1721-45d0-a562-1c69c416e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f9405c-1721-45d0-a562-1c69c416e823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1399487886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ebdd6b-d595-4c12-b63d-a087c6ee4d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f0403e35094022a7c8d561a2cc6835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:26Z,use_quota=True,user_id='9e0dc62e572242e3822d962ba2d3cacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:25 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5 Nov 03 17:34:25 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534a7ab4-3b55-4a81-8458-97f09966dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534a7ab4-3b55-4a81-8458-97f09966dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213695e1-34b4-4101-875b-989b1108ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213695e1-34b4-4101-875b-989b1108ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ebdd6b-d595-4c12-b63d-a087c6ee4d23', 'volume_name': 'volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c98a990-88fa-4de8-a4a9-8748af2ed4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c98a990-88fa-4de8-a4a9-8748af2ed4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1a05b5-a22f-4987-a4ab-d7c49d6faf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:25 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Volume c5ebdd6b-d595-4c12-b63d-a087c6ee4d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23', 'volume_size': 1} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1399487886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ebdd6b-d595-4c12-b63d-a087c6ee4d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f0403e35094022a7c8d561a2cc6835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:26Z,use_quota=True,user_id='9e0dc62e572242e3822d962ba2d3cacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Creating volume c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:25 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:25 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 1073741824 Nov 03 17:34:25 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:25 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd.829c528f-4071-4d2a-931e-874e417628d5" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-829c528f-4071-4d2a-931e-874e417628d5" released by "_delete_snapshot" :: held 1.553s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" released by "delete_snapshot" :: held 1.579s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Created reservations ['7ca0502c-7f99-4ddf-837c-1418f15f1601', '8b117f41-29b5-426e-9ce2-86941f87a574', '9b2ab27f-3de4-4711-bed9-0fa94306da03', '03704e0d-f1ff-49ad-9ae5-b155cd69ac62'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Delete snapshot completed successfully. Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fc06dc95-d627-4dac-8884-7948988fecbb tempest-CinderUnicodeTest-295527770 None] Lock "cinder-829c528f-4071-4d2a-931e-874e417628d5-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:26 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 1073741824" returned: 0 in 0.432s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:26 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 Nov 03 17:34:26 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:26 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" returned: 0 in 0.241s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1a05b5-a22f-4987-a4ab-d7c49d6faf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2fead8-74ed-4790-b568-4e722db444cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:26 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Volume volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 (c5ebdd6b-d595-4c12-b63d-a087c6ee4d23): created successfully Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2fead8-74ed-4790-b568-4e722db444cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Flow 'volume_create_manager' (fc33286f-4e77-41db-a52d-6bbff71eb473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6e034812-cf37-424c-bd1d-a35b8a420c3e tempest-VolumesNegativeTest-639428232 None] Created volume successfully. Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-c964b652-bb41-439f-83ec-2052c193a9bd-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-c964b652-bb41-439f-83ec-2052c193a9bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356b2f3-c14f-4904-9fba-d7c458f8e245]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:26 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd Nov 03 17:34:26 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:27 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:27 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd Nov 03 17:34:27 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:27 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c964b652-bb41-439f-83ec-2052c193a9bd" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-c964b652-bb41-439f-83ec-2052c193a9bd" released by "delete_volume" :: held 0.739s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Created reservations ['8dfda6d2-7443-46e8-ba66-ae57c9dfe140', 'f7c1d93b-af38-4a62-9454-b35483b38d28', '71d74934-fced-43ca-9679-817c98f36f0e', '05fcea9a-5a4e-4bcb-a4db-4a4867df74df'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:27 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:27 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:27 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.290s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Deleted volume successfully. Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "cinder-quobyte-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0d68b36-8ba9-4fd3-a6cb-26f8f62b0ef6 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-c964b652-bb41-439f-83ec-2052c193a9bd-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c81927b-3860-4423-9481-041dc1c8c55a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:28 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 Nov 03 17:34:28 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:28 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:28 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5 Nov 03 17:34:28 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:28 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" returned: 0 in 0.263s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-quobyte-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5" released by "delete_volume" :: held 0.715s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Created reservations ['4f13db4b-c38e-4db6-b827-400c5db6f17b', '9b317f84-b1e0-4918-b60e-35c796368505', '06ed0d76-85bf-4203-8da5-ccc5ae4e7dd4', '497a6d39-3ebe-4731-94b1-1460228623b8'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:28 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:28 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:29 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:29 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:29 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Deleted volume successfully. Nov 03 17:34:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b8844ec3-e0e2-4179-95e3-d6710a93b453 tempest-CinderUnicodeTest-295527770 None] Lock "cinder-a4ccfaa9-0f11-4c24-8c90-d54ad6942cd5-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=154,cinder:UPDATE=223,cinder:DELETE=22,cinder:INSERT=59 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:38 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:38 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=151,cinder:UPDATE=190,cinder:INSERT=54,cinder:DELETE=13 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:34:39 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.330s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:34:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Acquiring lock "cinder-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "cinder-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Acquiring lock "cinder-quobyte-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "cinder-quobyte-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed73d8b0-6664-4498-8dd6-7209f90f7423]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:34:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:44 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 Nov 03 17:34:44 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:45 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:45 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23 Nov 03 17:34:45 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:45 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" returned: 0 in 0.263s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "cinder-quobyte-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23" released by "delete_volume" :: held 0.715s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Created reservations ['6cbff699-28be-4a48-b11c-73467206f9d5', '7d34fa21-ecea-4655-be56-f3e2313cd6f3', '8168f209-cdbb-460e-ba0c-a2fc7acfb14c', '6c1721c9-7919-49f8-8d9f-ee5c33653268'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:45 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:34:45 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:45 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:34:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Deleted volume successfully. Nov 03 17:34:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-62665453-e440-4c7a-b143-300b8e4fe7b8 tempest-VolumesNegativeTest-639428232 None] Lock "cinder-c5ebdd6b-d595-4c12-b63d-a087c6ee4d23-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:34:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:34:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Flow 'volume_create_manager' (7ad6c3e0-4bbc-4bc4-82eb-f40f8f5048cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19acd9b-fa9c-4e8b-bda5-77e400e79c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19acd9b-fa9c-4e8b-bda5-77e400e79c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1212368638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad10149-bef3-40cc-ba9b-c70a157f1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b099f8a6ae4140b65950bdc76aa560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:58Z,use_quota=True,user_id='44dc9f16a3364addbcbaf82c134f30b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9c3559-8eab-4d2d-aa4a-e9f25e75bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9c3559-8eab-4d2d-aa4a-e9f25e75bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d2048-c8e7-4046-9f54-c0b39405ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d2048-c8e7-4046-9f54-c0b39405ced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad10149-bef3-40cc-ba9b-c70a157f1e6b', 'volume_name': 'volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0651755f-40a8-4b57-8dd3-ce9a14af5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0651755f-40a8-4b57-8dd3-ce9a14af5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ca2bdd-13d2-437a-9db5-782923a47939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Volume 1ad10149-bef3-40cc-ba9b-c70a157f1e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b', 'volume_size': 1} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1212368638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad10149-bef3-40cc-ba9b-c70a157f1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b099f8a6ae4140b65950bdc76aa560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:34:58Z,use_quota=True,user_id='44dc9f16a3364addbcbaf82c134f30b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Creating volume 1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:34:57 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:34:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:57 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b 1073741824 Nov 03 17:34:57 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b 1073741824" returned: 0 in 0.480s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:58 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:34:58 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:34:58 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:34:58 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ca2bdd-13d2-437a-9db5-782923a47939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b214153b-b097-4417-9d91-487a462aa22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:34:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Volume volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b (1ad10149-bef3-40cc-ba9b-c70a157f1e6b): created successfully Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b214153b-b097-4417-9d91-487a462aa22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:34:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Flow 'volume_create_manager' (7ad6c3e0-4bbc-4bc4-82eb-f40f8f5048cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:34:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-48007fac-bd1d-4610-afad-8d78d6ba6000 tempest-SnapshotDependencyTests-861424150 None] Created volume successfully. Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Creating offline snapshot f40e17fc-405f-4e99-9725-03f200ab30f4 of volume 1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca81e0-8131-4ab5-9d85-aa5528611996]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:00 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:35:00 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:00 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.493s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:00 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 1G Nov 03 17:35:00 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:01 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 1G" returned: 0 in 0.455s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:01 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:01 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:01 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:01 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 is being set with open permissions: ugo+rw Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:01 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:01 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:01 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:01 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info Nov 03 17:35:01 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:02 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:02 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info is being set with open permissions: ugo+rw Nov 03 17:35:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:02 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info Nov 03 17:35:02 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:02 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.info" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7cb65586-5755-43d6-b525-8a9a6f37dd90 tempest-SnapshotDependencyTests-861424150 None] Create snapshot completed successfully Nov 03 17:35:03 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Flow 'volume_create_manager' (39e38fc8-66de-4618-a996-620a859321b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e92615-6355-47ed-a22c-bfd97d79d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e92615-6355-47ed-a22c-bfd97d79d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8623daa7-75a8-4312-bbd1-02dd48ee13cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b099f8a6ae4140b65950bdc76aa560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f40e17fc-405f-4e99-9725-03f200ab30f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:35:04Z,use_quota=True,user_id='44dc9f16a3364addbcbaf82c134f30b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18ef047-ae9b-4716-9c18-1d199765491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18ef047-ae9b-4716-9c18-1d199765491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535bd396-ee98-45e3-8c70-08e645aa7d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535bd396-ee98-45e3-8c70-08e645aa7d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8623daa7-75a8-4312-bbd1-02dd48ee13cd', 'volume_name': 'volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd', 'volume_size': 1, 'snapshot_id': 'f40e17fc-405f-4e99-9725-03f200ab30f4'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd0bdec-881f-4203-ae9d-4037abea7895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd0bdec-881f-4203-ae9d-4037abea7895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb31b1c4-2cd0-4a3b-a162-13b8b4106388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:04 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Volume 8623daa7-75a8-4312-bbd1-02dd48ee13cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd', 'volume_size': 1, 'snapshot_id': 'f40e17fc-405f-4e99-9725-03f200ab30f4'} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4-8623daa7-75a8-4312-bbd1-02dd48ee13cd" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4-8623daa7-75a8-4312-bbd1-02dd48ee13cd" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Creating volume 8623daa7-75a8-4312-bbd1-02dd48ee13cd from snapshot f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] snapshot: f40e17fc-405f-4e99-9725-03f200ab30f4, volume: 8623daa7-75a8-4312-bbd1-02dd48ee13cd, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda9d93-5353-48c8-bcd3-040cfec6e854]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:04 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:04 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:04 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.375s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[302c9921-2976-4aee-95c0-89a8120e51d3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:04 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:35:04 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:04 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:35:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:35:05 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:35:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:05 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd Nov 03 17:35:05 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:11 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd" returned: 0 in 6.945s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:11 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:35:11 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Converted 1024.00 MB image at 147.41 MB/s Nov 03 17:35:11 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd is being set with open permissions: ugo+rw Nov 03 17:35:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:11 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd Nov 03 17:35:11 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:12 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" released by "_copy_volume_from_snapshot" :: held 8.073s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4-8623daa7-75a8-4312-bbd1-02dd48ee13cd" released by "_create_volume_from_snapshot" :: held 8.135s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.155s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb31b1c4-2cd0-4a3b-a162-13b8b4106388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd', 'volume_size': 1, 'snapshot_id': 'f40e17fc-405f-4e99-9725-03f200ab30f4'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c461a3-bbb8-4329-9c9f-41b7c05ac417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:12 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Volume volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd (8623daa7-75a8-4312-bbd1-02dd48ee13cd): created successfully Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c461a3-bbb8-4329-9c9f-41b7c05ac417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Flow 'volume_create_manager' (39e38fc8-66de-4618-a996-620a859321b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:35:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b30e9230-80bc-483f-9c2e-3853f604c5b1 tempest-SnapshotDependencyTests-861424150 None] Created volume successfully. Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-f40e17fc-405f-4e99-9725-03f200ab30f4-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-f40e17fc-405f-4e99-9725-03f200ab30f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Deleting offline snapshot f40e17fc-405f-4e99-9725-03f200ab30f4 of volume 1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] snapshot_file for this snap is: volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e19d96-fe7f-4d9e-a02f-76275048120e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:13 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:13 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:13 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.474s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:35:13 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa0b04-76bb-451b-b277-8dd0fab785eb]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:13 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:35:13 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:13 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.545s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:14 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:14 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:14 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.348s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:14 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4 Nov 03 17:35:14 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:14 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b.f40e17fc-405f-4e99-9725-03f200ab30f4" returned: 0 in 0.243s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-f40e17fc-405f-4e99-9725-03f200ab30f4" released by "_delete_snapshot" :: held 1.736s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" released by "delete_snapshot" :: held 1.770s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Created reservations ['cc96adde-646d-4707-aa20-18e270a91c1e', '68d6c7bb-21a5-45ad-afca-065205964944', '5bb84b20-fe7b-4586-a5d6-c9f143299c08', 'b0a8d1b3-1215-4e34-a16d-ffac5673a28d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:35:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Delete snapshot completed successfully. Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b91cbf0-2787-4891-9ab2-3d51a34f3f6d tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-f40e17fc-405f-4e99-9725-03f200ab30f4-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-1ad10149-bef3-40cc-ba9b-c70a157f1e6b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-1ad10149-bef3-40cc-ba9b-c70a157f1e6b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5860f0e5-b086-4fc0-9b9b-d36a24426809]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:15 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:35:15 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:15 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.376s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:15 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b Nov 03 17:35:15 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:15 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-1ad10149-bef3-40cc-ba9b-c70a157f1e6b" released by "delete_volume" :: held 0.714s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Created reservations ['8ff890b0-7442-42fe-bc78-cea05fd9cd42', '7f43ea99-20c5-4a48-82c6-426a7ccdc92a', '8fc1a2ea-cc2c-4d11-9131-589dd60e30a5', '52958abf-5966-4b06-bb78-61826cf1d7fe'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:15 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:35:15 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:16 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-8623daa7-75a8-4312-bbd1-02dd48ee13cd-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:35:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Deleted volume successfully. Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-8623daa7-75a8-4312-bbd1-02dd48ee13cd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a86e7e0d-7aed-434a-814b-8fd84bfd1fab tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-1ad10149-bef3-40cc-ba9b-c70a157f1e6b-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[43635320-7f59-4e3e-82cc-2866217c09cc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:16 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd Nov 03 17:35:16 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:16 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd" returned: 0 in 0.367s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:16 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd Nov 03 17:35:16 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:16 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8623daa7-75a8-4312-bbd1-02dd48ee13cd" returned: 0 in 0.238s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-quobyte-8623daa7-75a8-4312-bbd1-02dd48ee13cd" released by "delete_volume" :: held 0.659s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:16 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Created reservations ['af325af9-c7b1-4468-899a-49b21143d674', '5214a7d7-eec2-450b-89a8-5a5bde898fcd', '796e576a-a544-4509-ae6b-bc6c58a4d1a8', 'ed734882-1871-49aa-8898-795d4a52a036'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:17 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:35:17 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:17 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:35:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Deleted volume successfully. Nov 03 17:35:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b6d3e6e4-05b2-4636-b869-b58e1405067f tempest-SnapshotDependencyTests-861424150 None] Lock "cinder-8623daa7-75a8-4312-bbd1-02dd48ee13cd-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:27 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=24,cinder:SELECT=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:35:27 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:38 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:35:38 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:39 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.241s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:35:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:35:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:35:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Flow 'volume_create_manager' (cad92808-dcf5-4159-a885-f9a2963b52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3860e618-71de-4134-844e-4f318f5a48b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3860e618-71de-4134-844e-4f318f5a48b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-790904808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262a653c-b608-42b9-a628-ae712bd25bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cc74c85cdc4b90a2f9f9010d964952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:35:45Z,use_quota=True,user_id='5775fc3d7a8b4379908b6cb2aa6afd78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d670acef-f31a-4acd-8362-ae77d38336ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d670acef-f31a-4acd-8362-ae77d38336ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb56112-7788-4288-b582-cd0ed8650132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb56112-7788-4288-b582-cd0ed8650132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262a653c-b608-42b9-a628-ae712bd25bc2', 'volume_name': 'volume-262a653c-b608-42b9-a628-ae712bd25bc2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b998dcdb-e485-42ba-bbb3-c1cab22d6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b998dcdb-e485-42ba-bbb3-c1cab22d6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd2214-f9f2-456f-87bd-264289a7cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Volume 262a653c-b608-42b9-a628-ae712bd25bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262a653c-b608-42b9-a628-ae712bd25bc2', 'volume_size': 1} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-790904808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262a653c-b608-42b9-a628-ae712bd25bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cc74c85cdc4b90a2f9f9010d964952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:35:45Z,use_quota=True,user_id='5775fc3d7a8b4379908b6cb2aa6afd78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Creating volume 262a653c-b608-42b9-a628-ae712bd25bc2 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:35:44 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:35:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:44 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 1073741824 Nov 03 17:35:44 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:45 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 1073741824" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:45 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 Nov 03 17:35:45 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:45 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2" returned: 0 in 0.237s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd2214-f9f2-456f-87bd-264289a7cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262a653c-b608-42b9-a628-ae712bd25bc2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a51999-74d2-4c2f-88be-fd3a24008c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:35:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Volume volume-262a653c-b608-42b9-a628-ae712bd25bc2 (262a653c-b608-42b9-a628-ae712bd25bc2): created successfully Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a51999-74d2-4c2f-88be-fd3a24008c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:35:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Flow 'volume_create_manager' (cad92808-dcf5-4159-a885-f9a2963b52cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:35:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1ed788b3-4761-4adf-a8c7-3151acc935b9 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Created volume successfully. Nov 03 17:35:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d5d2d541-bb7c-4c99-a095-9e6430b8af3c req-dea23eb5-0a85-4e87-8ef6-2fbd52e412d3 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d5d2d541-bb7c-4c99-a095-9e6430b8af3c req-dea23eb5-0a85-4e87-8ef6-2fbd52e412d3 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-d5d2d541-bb7c-4c99-a095-9e6430b8af3c req-dea23eb5-0a85-4e87-8ef6-2fbd52e412d3 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-d5d2d541-bb7c-4c99-a095-9e6430b8af3c req-dea23eb5-0a85-4e87-8ef6-2fbd52e412d3 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-262a653c-b608-42b9-a628-ae712bd25bc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fc49f65-754d-4392-a83e-53641b5fc2e8', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:35:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-d5d2d541-bb7c-4c99-a095-9e6430b8af3c req-dea23eb5-0a85-4e87-8ef6-2fbd52e412d3 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] attachment_update completed successfully. Nov 03 17:35:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-d20e5f52-8115-43ee-9d50-e0bc737953cf req-cb037d22-9d13-4569-86ee-4786bd73cdaf tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Terminate volume connection completed successfully. Nov 03 17:35:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-d20e5f52-8115-43ee-9d50-e0bc737953cf req-cb037d22-9d13-4569-86ee-4786bd73cdaf tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Deleting attachment 9fc49f65-754d-4392-a83e-53641b5fc2e8. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "cinder-262a653c-b608-42b9-a628-ae712bd25bc2-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "cinder-262a653c-b608-42b9-a628-ae712bd25bc2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "cinder-quobyte-262a653c-b608-42b9-a628-ae712bd25bc2" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "cinder-quobyte-262a653c-b608-42b9-a628-ae712bd25bc2" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[31643a18-c01c-4a3f-a4cd-5a3608cf9f99]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:35:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:49 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 Nov 03 17:35:49 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:50 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2" returned: 0 in 0.343s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:50 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2 Nov 03 17:35:50 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:50 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-262a653c-b608-42b9-a628-ae712bd25bc2" returned: 0 in 0.234s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "cinder-quobyte-262a653c-b608-42b9-a628-ae712bd25bc2" released by "delete_volume" :: held 0.613s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Created reservations ['340b5288-bcab-4693-a855-bdc252e3459d', '34ac80e9-3180-4e9d-b3b2-a1c64638a096', 'adcb5208-cdff-4697-9e29-796f2386ca97', '590f778d-074e-4e29-a68d-2f8b6686258b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:35:50 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:35:50 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:35:50 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.238s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:35:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Deleted volume successfully. Nov 03 17:35:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-20823f81-e2a5-483f-b3ee-b8aa4f5691d7 tempest-TestServerVolumeAttachScenarioOldVersion-1102636333 None] Lock "cinder-262a653c-b608-42b9-a628-ae712bd25bc2-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:36:00 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:36:00 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=14,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Flow 'volume_create_manager' (2d4923c7-f5b8-4b2c-89d4-399464a84ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccfdfc-35e6-48fb-938c-2bbb9ccd6883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccfdfc-35e6-48fb-938c-2bbb9ccd6883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1568283521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba4760a-92df-4e4d-81f6-2933274b1c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2dd0e8fbdc4e198e3bc7df50c84824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:36:28Z,use_quota=True,user_id='37e80b139e4a478ea966a19207621f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef12872-9490-4384-bab9-6075c8afdde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef12872-9490-4384-bab9-6075c8afdde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ddf5a7-3a0a-4d94-a266-f26a85f07e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ddf5a7-3a0a-4d94-a266-f26a85f07e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ba4760a-92df-4e4d-81f6-2933274b1c58', 'volume_name': 'volume-9ba4760a-92df-4e4d-81f6-2933274b1c58', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23df7c3-098b-4d11-a361-d4a0cdb58796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23df7c3-098b-4d11-a361-d4a0cdb58796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97604280-6b3c-4d8e-8bf7-0fdf839986d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:27 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Volume 9ba4760a-92df-4e4d-81f6-2933274b1c58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ba4760a-92df-4e4d-81f6-2933274b1c58', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:36:27 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Trying to clone 9ba4760a-92df-4e4d-81f6-2933274b1c58 from image 0146c52b-9712-4e77-91c3-cd4953180efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:36:28 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8838b1-edce-4c66-8c45-cf4f60360fd1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:28 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD Nov 03 17:36:28 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:28 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe is fetched for user 37e80b139e4a478ea966a19207621f7c. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ccb1e-c6c5-4462-a7f3-6b51acc4eaa4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:28 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD Nov 03 17:36:28 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:28 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1568283521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba4760a-92df-4e4d-81f6-2933274b1c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2dd0e8fbdc4e198e3bc7df50c84824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:36:28Z,use_quota=True,user_id='37e80b139e4a478ea966a19207621f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Creating volume 9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:36:28 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:36:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:29 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1073741824 Nov 03 17:36:29 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:29 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1073741824" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:29 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 Nov 03 17:36:29 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:29 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Attempting download of 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 9ba4760a-92df-4e4d-81f6-2933274b1c58. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f030e4-ac46-433f-81cc-385be38d4594]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:36:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:29 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6 Nov 03 17:36:29 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:30 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:30 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6 Nov 03 17:36:30 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:30 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6" returned: 1 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0146c52b-9712-4e77-91c3-cd4953180efe_ql9alem6' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c13f21-a005-4c08-9147-dd67bf56a568]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:30 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD Nov 03 17:36:30 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:30 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] 0146c52b-9712-4e77-91c3-cd4953180efe was qcow2, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:36:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:30 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 Nov 03 17:36:30 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:32 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58" returned: 0 in 1.736s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0146c52b-9712-4e77-91c3-cd4953180efe_126fpvm0devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:36:32 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Converted 112.00 MB image at 64.46 MB/s Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:32 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1G Nov 03 17:36:32 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:32 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 1G" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Downloaded image 0146c52b-9712-4e77-91c3-cd4953180efe ((None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}])) to volume 9ba4760a-92df-4e4d-81f6-2933274b1c58 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Temporary image 0146c52b-9712-4e77-91c3-cd4953180efe for user 37e80b139e4a478ea966a19207621f7c is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Marking volume 9ba4760a-92df-4e4d-81f6-2933274b1c58 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Copying metadata from image 0146c52b-9712-4e77-91c3-cd4953180efe to 9ba4760a-92df-4e4d-81f6-2933274b1c58. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Creating volume glance metadata for volume 9ba4760a-92df-4e4d-81f6-2933274b1c58 backed by image 0146c52b-9712-4e77-91c3-cd4953180efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97604280-6b3c-4d8e-8bf7-0fdf839986d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba4760a-92df-4e4d-81f6-2933274b1c58', 'volume_size': 1, 'image_id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0146c52b-9712-4e77-91c3-cd4953180efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '480767a6d19547579bbd4e711383053b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0146c52b-9712-4e77-91c3-cd4953180efe', 'created_at': datetime.datetime(2026, 11, 3, 16, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 12, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0146c52b-9712-4e77-91c3-cd4953180efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4cd67-6e64-49d9-a2f2-c32a09ac6c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:36:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Volume volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 (9ba4760a-92df-4e4d-81f6-2933274b1c58): created successfully Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4cd67-6e64-49d9-a2f2-c32a09ac6c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:36:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Flow 'volume_create_manager' (2d4923c7-f5b8-4b2c-89d4-399464a84ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:36:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-116178b1-f265-4952-a5dd-a603a2c13065 tempest-TestShelveInstance-1217249337 None] Created volume successfully. Nov 03 17:36:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7d2ac84e-6a92-4fbc-aa7a-82720b49586e req-e2eec2a2-7e62-4d59-9963-b6ef6e7b3100 tempest-TestShelveInstance-1217249337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:36:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7d2ac84e-6a92-4fbc-aa7a-82720b49586e req-e2eec2a2-7e62-4d59-9963-b6ef6e7b3100 tempest-TestShelveInstance-1217249337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:36:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7d2ac84e-6a92-4fbc-aa7a-82720b49586e req-e2eec2a2-7e62-4d59-9963-b6ef6e7b3100 tempest-TestShelveInstance-1217249337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:36:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-7d2ac84e-6a92-4fbc-aa7a-82720b49586e req-e2eec2a2-7e62-4d59-9963-b6ef6e7b3100 tempest-TestShelveInstance-1217249337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-9ba4760a-92df-4e4d-81f6-2933274b1c58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49e824ba-447d-4ea8-a4c4-3e2355426fbb', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:36:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-7d2ac84e-6a92-4fbc-aa7a-82720b49586e req-e2eec2a2-7e62-4d59-9963-b6ef6e7b3100 tempest-TestShelveInstance-1217249337 None] attachment_update completed successfully. Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:36:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:36:38 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:36:38 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:36:39 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Nov 03 17:36:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.416s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:36:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:36:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:36:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:36:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:36:46 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=7,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:36:46 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=16,cinder:INSERT=8,cinder:UPDATE=5 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:37:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-a4a26de2-58e0-4d23-8e4e-b1cee890331c req-f3e78fb2-352b-4b64-ab1b-ed164d6b0ae3 tempest-TestShelveInstance-1217249337 None] Terminate volume connection completed successfully. Nov 03 17:37:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-a4a26de2-58e0-4d23-8e4e-b1cee890331c req-f3e78fb2-352b-4b64-ab1b-ed164d6b0ae3 tempest-TestShelveInstance-1217249337 None] Deleting attachment 49e824ba-447d-4ea8-a4c4-3e2355426fbb. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:37:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7fcbc58c-5822-4b2f-86e9-68eafc1aac5f req-a544dd21-02d6-4da5-b6a9-544129fba9fb tempest-TestShelveInstance-1217249337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:37:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7fcbc58c-5822-4b2f-86e9-68eafc1aac5f req-a544dd21-02d6-4da5-b6a9-544129fba9fb tempest-TestShelveInstance-1217249337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:37:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-7fcbc58c-5822-4b2f-86e9-68eafc1aac5f req-a544dd21-02d6-4da5-b6a9-544129fba9fb tempest-TestShelveInstance-1217249337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:37:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-7fcbc58c-5822-4b2f-86e9-68eafc1aac5f req-a544dd21-02d6-4da5-b6a9-544129fba9fb tempest-TestShelveInstance-1217249337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-9ba4760a-92df-4e4d-81f6-2933274b1c58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45091e98-8ee4-4334-b8a9-0956c17d1352', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:37:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-7fcbc58c-5822-4b2f-86e9-68eafc1aac5f req-a544dd21-02d6-4da5-b6a9-544129fba9fb tempest-TestShelveInstance-1217249337 None] attachment_update completed successfully. Nov 03 17:37:20 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:37:20 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=8 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:37:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:37:38 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:37:38 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:37:39 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 03 17:37:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:37:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:37:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:37:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:37:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:37:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:37:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:37:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-66f69a89-1652-4572-ba99-68d87356b262 tempest-TestShelveInstance-1217249337 None] Terminate volume connection completed successfully. Nov 03 17:37:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-66f69a89-1652-4572-ba99-68d87356b262 tempest-TestShelveInstance-1217249337 None] Deleting attachment 45091e98-8ee4-4334-b8a9-0956c17d1352. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Acquiring lock "cinder-9ba4760a-92df-4e4d-81f6-2933274b1c58-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "cinder-9ba4760a-92df-4e4d-81f6-2933274b1c58-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Acquiring lock "cinder-quobyte-9ba4760a-92df-4e4d-81f6-2933274b1c58" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "cinder-quobyte-9ba4760a-92df-4e4d-81f6-2933274b1c58" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db74b1b-d25f-44ce-9b50-c5ea30f7d3f6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:37:53 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 Nov 03 17:37:53 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:37:53 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58" returned: 0 in 0.401s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:37:53 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58 Nov 03 17:37:53 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:37:53 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9ba4760a-92df-4e4d-81f6-2933274b1c58" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "cinder-quobyte-9ba4760a-92df-4e4d-81f6-2933274b1c58" released by "delete_volume" :: held 0.712s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:37:53 devstack cinder-volume[86995]: DEBUG cinder.quota [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Created reservations ['10602ea0-c78b-44e1-a225-351194507782', 'd1b99e96-fb4f-4263-bcda-4a88c62e169f', 'b2246bf0-61df-4599-8914-e4b1c18355fa', '1097d5b4-931c-419c-8e95-edde288164a1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:37:54 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:37:54 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:37:54 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.260s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG cinder.manager [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:37:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Deleted volume successfully. Nov 03 17:37:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [req-4b548e9c-a3f6-4ef7-a6cb-5b81ef302350 req-ba165eeb-23c8-4145-9830-80111e9808ac tempest-TestShelveInstance-1217249337 None] Lock "cinder-9ba4760a-92df-4e4d-81f6-2933274b1c58-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:38:04 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:38:04 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Flow 'volume_create_manager' (96dd40ad-b435-40e9-8dbb-e24104bf9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5040b0af-77ee-4c88-b518-8b5bcbfd0a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5040b0af-77ee-4c88-b518-8b5bcbfd0a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1592336097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604bb109-542c-4fe9-89d4-3640a79d40bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ab7058f54647eb9208879975c711ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:38:27Z,use_quota=True,user_id='860159d8b6d045bd97a2fffcbecbb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e711236-3a36-4d7d-aac9-b95ca7398043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e711236-3a36-4d7d-aac9-b95ca7398043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f061b1e-6398-4dd3-a671-69a0de27ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f061b1e-6398-4dd3-a671-69a0de27ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604bb109-542c-4fe9-89d4-3640a79d40bd', 'volume_name': 'volume-604bb109-542c-4fe9-89d4-3640a79d40bd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd546e-193b-4762-ae69-2f9328b78806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd546e-193b-4762-ae69-2f9328b78806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22e24f-25c0-456c-8848-61b46ccdde4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:26 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Volume 604bb109-542c-4fe9-89d4-3640a79d40bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604bb109-542c-4fe9-89d4-3640a79d40bd', 'volume_size': 1} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1592336097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604bb109-542c-4fe9-89d4-3640a79d40bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ab7058f54647eb9208879975c711ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:38:27Z,use_quota=True,user_id='860159d8b6d045bd97a2fffcbecbb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Creating volume 604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:38:26 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:38:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:38:26 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd 1073741824 Nov 03 17:38:26 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:38:27 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd 1073741824" returned: 0 in 0.451s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:38:27 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:38:27 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:38:27 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22e24f-25c0-456c-8848-61b46ccdde4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604bb109-542c-4fe9-89d4-3640a79d40bd', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad24a62e-72ba-442f-b80c-17c05aa43b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:38:27 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Volume volume-604bb109-542c-4fe9-89d4-3640a79d40bd (604bb109-542c-4fe9-89d4-3640a79d40bd): created successfully Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad24a62e-72ba-442f-b80c-17c05aa43b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:38:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Flow 'volume_create_manager' (96dd40ad-b435-40e9-8dbb-e24104bf9949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:38:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-be6ea47d-e53a-4a63-8666-7425ddd14648 tempest-TestStampPattern-527176262 None] Created volume successfully. Nov 03 17:38:37 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=5 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:38:37 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:38:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:38:38 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:38:38 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:38:39 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Nov 03 17:38:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:38:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:38:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:38:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:38:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:38:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-e5285fdd-0dd3-4ae7-8276-03a75362882d req-05e1869f-8c96-468c-8661-53f03cf0067f tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:38:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-e5285fdd-0dd3-4ae7-8276-03a75362882d req-05e1869f-8c96-468c-8661-53f03cf0067f tempest-TestStampPattern-527176262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:38:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-e5285fdd-0dd3-4ae7-8276-03a75362882d req-05e1869f-8c96-468c-8661-53f03cf0067f tempest-TestStampPattern-527176262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:38:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-e5285fdd-0dd3-4ae7-8276-03a75362882d req-05e1869f-8c96-468c-8661-53f03cf0067f tempest-TestStampPattern-527176262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-604bb109-542c-4fe9-89d4-3640a79d40bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60205ac6-1066-4571-a83c-55fe69ffa4d7', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:38:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-e5285fdd-0dd3-4ae7-8276-03a75362882d req-05e1869f-8c96-468c-8661-53f03cf0067f tempest-TestStampPattern-527176262 None] attachment_update completed successfully. Nov 03 17:39:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-6f735560-ab78-461b-8ca8-8d2f00bbd558 req-f90121f0-2717-4bf1-bdc1-0f9a6b97cc64 tempest-TestStampPattern-527176262 None] Terminate volume connection completed successfully. Nov 03 17:39:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-6f735560-ab78-461b-8ca8-8d2f00bbd558 req-f90121f0-2717-4bf1-bdc1-0f9a6b97cc64 tempest-TestStampPattern-527176262 None] Deleting attachment 60205ac6-1066-4571-a83c-55fe69ffa4d7. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Creating offline snapshot 465857e2-8468-4f69-bc27-feffea41960c of volume 604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3847d26-d55f-418f-97f9-91c6eda1bfc9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:02 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:39:02 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:02 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:02 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c 1G Nov 03 17:39:02 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:03 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c 1G" returned: 0 in 0.398s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604bb109-542c-4fe9-89d4-3640a79d40bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:03 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604bb109-542c-4fe9-89d4-3640a79d40bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:39:03 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:03 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604bb109-542c-4fe9-89d4-3640a79d40bd -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:03 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c is being set with open permissions: ugo+rw Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:03 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:39:03 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:03 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.249s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:03 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info Nov 03 17:39:03 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:04 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:04 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info is being set with open permissions: ugo+rw Nov 03 17:39:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:04 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info Nov 03 17:39:04 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:04 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.info" returned: 0 in 0.239s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:39:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bb27eea5-23e0-42cb-8c3b-57736e9b6dd8 tempest-TestStampPattern-527176262 None] Create snapshot completed successfully Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Flow 'volume_create_manager' (1de14fbe-1bab-4fc1-972b-02611c7f415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e185655-eb25-4028-a230-55aca46b23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e185655-eb25-4028-a230-55aca46b23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1544219152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42fc7e8-7fc2-46cf-a670-61f1c4ef4372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ab7058f54647eb9208879975c711ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=465857e2-8468-4f69-bc27-feffea41960c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:39:11Z,use_quota=True,user_id='860159d8b6d045bd97a2fffcbecbb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a0aab-05f6-4ded-b851-4eb707bdccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a0aab-05f6-4ded-b851-4eb707bdccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b1f235-6888-4b1e-933b-1977f93868f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b1f235-6888-4b1e-933b-1977f93868f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b42fc7e8-7fc2-46cf-a670-61f1c4ef4372', 'volume_name': 'volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372', 'volume_size': 1, 'snapshot_id': '465857e2-8468-4f69-bc27-feffea41960c'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ce26cf-a65c-414a-8479-05a9984f1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ce26cf-a65c-414a-8479-05a9984f1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d2709-1866-4171-be2d-3ca621a1c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:11 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Volume b42fc7e8-7fc2-46cf-a670-61f1c4ef4372: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372', 'volume_size': 1, 'snapshot_id': '465857e2-8468-4f69-bc27-feffea41960c'} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Creating volume b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 from snapshot 465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] snapshot: 465857e2-8468-4f69-bc27-feffea41960c, volume: b42fc7e8-7fc2-46cf-a670-61f1c4ef4372, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b77065-b0b2-4a62-aa03-189611d0c30f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:11 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:39:11 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:11 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604bb109-542c-4fe9-89d4-3640a79d40bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200eb41-0ceb-4988-b03b-db34ab2ae736]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:39:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:11 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:39:11 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:12 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:39:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:39:12 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:39:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:12 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 Nov 03 17:39:12 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:20 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" returned: 0 in 8.189s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:39:20 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Converted 1024.00 MB image at 125.03 MB/s Nov 03 17:39:20 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 is being set with open permissions: ugo+rw Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:20 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 Nov 03 17:39:20 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:20 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" returned: 0 in 0.449s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" released by "_copy_volume_from_snapshot" :: held 9.542s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" released by "_create_volume_from_snapshot" :: held 9.628s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.645s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d2709-1866-4171-be2d-3ca621a1c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372', 'volume_size': 1, 'snapshot_id': '465857e2-8468-4f69-bc27-feffea41960c'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14cefd-ad80-41ad-a618-c33cd2a4971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:39:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Volume volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 (b42fc7e8-7fc2-46cf-a670-61f1c4ef4372): created successfully Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14cefd-ad80-41ad-a618-c33cd2a4971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:39:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Flow 'volume_create_manager' (1de14fbe-1bab-4fc1-972b-02611c7f415e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:39:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9299db76-4a21-437f-b5c8-eab00ca478f6 tempest-TestStampPattern-527176262 None] Created volume successfully. Nov 03 17:39:30 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:39:30 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:39:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:39:38 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:39:38 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:39:39 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Nov 03 17:39:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.241s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:39:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:39:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:39:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:39:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:39:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:39:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:40:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-bcc2ce10-943f-4140-9fa5-d11239ff3116 req-8baa89da-e1e2-4033-87f0-de717a1962c5 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-bcc2ce10-943f-4140-9fa5-d11239ff3116 req-8baa89da-e1e2-4033-87f0-de717a1962c5 tempest-TestStampPattern-527176262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [req-bcc2ce10-943f-4140-9fa5-d11239ff3116 req-8baa89da-e1e2-4033-87f0-de717a1962c5 tempest-TestStampPattern-527176262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:01 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-bcc2ce10-943f-4140-9fa5-d11239ff3116 req-8baa89da-e1e2-4033-87f0-de717a1962c5 tempest-TestStampPattern-527176262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3', 'name': 'volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7745a4e9-f6c1-49eb-85ab-f63b69d245d4', 'enforce_multipath': True} {{(pid=86995) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:40:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-bcc2ce10-943f-4140-9fa5-d11239ff3116 req-8baa89da-e1e2-4033-87f0-de717a1962c5 tempest-TestStampPattern-527176262 None] attachment_update completed successfully. Nov 03 17:40:05 devstack cinder-volume[86995]: INFO cinder.volume.manager [req-345c84c7-0e92-4881-a246-f7a1926af2e9 req-f6ce7e19-63e8-4eb5-a42e-3367654c53ac tempest-TestStampPattern-527176262 None] Terminate volume connection completed successfully. Nov 03 17:40:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [req-345c84c7-0e92-4881-a246-f7a1926af2e9 req-f6ce7e19-63e8-4eb5-a42e-3367654c53ac tempest-TestStampPattern-527176262 None] Deleting attachment 7745a4e9-f6c1-49eb-85ab-f63b69d245d4. {{(pid=86995) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "cinder-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d945b-1a88-4192-ab20-c3c1fe6134af]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:09 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 Nov 03 17:40:09 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:09 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:09 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372 Nov 03 17:40:09 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:09 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" returned: 0 in 0.230s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372" released by "delete_volume" :: held 0.614s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Created reservations ['c5436e4f-53de-45dd-875b-6099c3b4b758', '245f51ed-58d2-464d-9737-c8346a8169cc', '8f0791aa-40f2-4b86-ad53-1c79fe8b12db', '6ffec0de-d8e3-4842-b71d-807c719b83e8'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:09 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:09 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:10 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.230s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Deleted volume successfully. Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2d568659-3dc0-40d9-a102-399164b0d0df tempest-TestStampPattern-527176262 None] Lock "cinder-b42fc7e8-7fc2-46cf-a670-61f1c4ef4372-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-465857e2-8468-4f69-bc27-feffea41960c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-465857e2-8468-4f69-bc27-feffea41960c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Deleting offline snapshot 465857e2-8468-4f69-bc27-feffea41960c of volume 604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] snapshot_file for this snap is: volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb1ee8a-1ba5-4b67-b573-f0aa1f21a1d1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:10 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:40:10 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:10 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604bb109-542c-4fe9-89d4-3640a79d40bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd584f8-81ea-4c3e-a6ec-292dafc394ac]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:11 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:40:11 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:11 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.501s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:11 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:40:11 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:11 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.307s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:11 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c Nov 03 17:40:11 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:12 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd.465857e2-8468-4f69-bc27-feffea41960c" returned: 0 in 0.230s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-465857e2-8468-4f69-bc27-feffea41960c" released by "_delete_snapshot" :: held 1.476s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" released by "delete_snapshot" :: held 1.496s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:12 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Created reservations ['9ba4e38f-3d73-43b8-a31e-fe1fbe315f92', '4113f5cb-acd4-4b01-8df3-f77938684766', '13fd9a13-9726-460d-8f25-124ced1efe8f', '128af2d4-5437-4220-805c-e0a3f8c67425'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Delete snapshot completed successfully. Nov 03 17:40:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2c992b3-8ef4-4166-a954-8364230abea4 tempest-TestStampPattern-527176262 None] Lock "cinder-465857e2-8468-4f69-bc27-feffea41960c-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-604bb109-542c-4fe9-89d4-3640a79d40bd-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "cinder-604bb109-542c-4fe9-89d4-3640a79d40bd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Acquiring lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" acquired by "delete_volume" :: waited 0.012s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2feca1-fbfd-4114-90f4-be48db87ce12]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:16 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:40:16 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:16 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.361s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:16 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd Nov 03 17:40:16 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:16 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-604bb109-542c-4fe9-89d4-3640a79d40bd" returned: 0 in 0.250s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "cinder-quobyte-604bb109-542c-4fe9-89d4-3640a79d40bd" released by "delete_volume" :: held 0.669s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Created reservations ['d9316dfc-dde3-44d4-8bfe-da6f62a4c1e0', '452ef4fe-73bb-429e-ae7a-1dc956c38353', 'd39dca65-ca5d-48d5-9c39-a2211e0f2a9d', '2469f159-b5cb-4736-a4ad-73ff3dc88702'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:17 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:17 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:17 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.239s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Deleted volume successfully. Nov 03 17:40:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-518cdd53-fbe9-4f7b-8de7-95951cccc229 tempest-TestStampPattern-527176262 None] Lock "cinder-604bb109-542c-4fe9-89d4-3640a79d40bd-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:27 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:40:27 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (d6dce898-db89-4984-aa34-e73a1755d708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359abc7f-c183-43db-bc97-8ace0f1cc173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359abc7f-c183-43db-bc97-8ace0f1cc173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167643735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f7cdaf-0d19-440f-8f0a-5249012dd23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:28Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee7f83-05b4-42e2-859b-33ea0e24db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee7f83-05b4-42e2-859b-33ea0e24db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58cd82-42ad-40c2-8188-6c2c9a887b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58cd82-42ad-40c2-8188-6c2c9a887b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f7cdaf-0d19-440f-8f0a-5249012dd23b', 'volume_name': 'volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44769147-08d3-4c24-8b62-b0f2c71ed2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44769147-08d3-4c24-8b62-b0f2c71ed2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdec69a-e41b-4640-9f74-68a8f744b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume a2f7cdaf-0d19-440f-8f0a-5249012dd23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b', 'volume_size': 1} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167643735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f7cdaf-0d19-440f-8f0a-5249012dd23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:28Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume a2f7cdaf-0d19-440f-8f0a-5249012dd23b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:28 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:28 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b 1073741824 Nov 03 17:40:28 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:28 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b 1073741824" returned: 0 in 0.402s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:28 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b Nov 03 17:40:28 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:28 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" returned: 0 in 0.241s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdec69a-e41b-4640-9f74-68a8f744b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31a3e6b-393b-4c67-9024-959d55cd412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b (a2f7cdaf-0d19-440f-8f0a-5249012dd23b): created successfully Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31a3e6b-393b-4c67-9024-959d55cd412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (d6dce898-db89-4984-aa34-e73a1755d708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:29 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e894f7cf-080f-4e1b-a5c2-93465305e179 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (2a408cc7-8368-40ac-a072-102af90d19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60577fc-2415-4d2c-a03c-279c760a024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60577fc-2415-4d2c-a03c-279c760a024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668743778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4279b87c-2a39-45d8-97df-7bd41cf8d8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e150453-3a79-4d0f-8483-96bfd3a8aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e150453-3a79-4d0f-8483-96bfd3a8aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d81991-f857-49ce-8828-ca2f74b1979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d81991-f857-49ce-8828-ca2f74b1979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4279b87c-2a39-45d8-97df-7bd41cf8d8ec', 'volume_name': 'volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c452e-1e55-4efc-bb20-36b8455c61e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c452e-1e55-4efc-bb20-36b8455c61e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59e4415-2de5-4267-b600-62d5942bbb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume 4279b87c-2a39-45d8-97df-7bd41cf8d8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec', 'volume_size': 1} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668743778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4279b87c-2a39-45d8-97df-7bd41cf8d8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume 4279b87c-2a39-45d8-97df-7bd41cf8d8ec {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:29 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:29 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec 1073741824 Nov 03 17:40:29 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (a2109266-5a79-4271-9e11-1991629c258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83e75f5-a50e-4f86-9a3d-0820fc7f9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83e75f5-a50e-4f86-9a3d-0820fc7f9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155191671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29508b93-b721-4fcc-83ca-788476058207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bdaa60-7322-459e-93f2-c7834862ddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bdaa60-7322-459e-93f2-c7834862ddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7b8352-410c-43fd-b58b-0ed9729d89fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7b8352-410c-43fd-b58b-0ed9729d89fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29508b93-b721-4fcc-83ca-788476058207', 'volume_name': 'volume-29508b93-b721-4fcc-83ca-788476058207', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82e492f-0d67-4507-9ab4-02120efbadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82e492f-0d67-4507-9ab4-02120efbadd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8907884b-8361-4bfd-b78b-081322cb0d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume 29508b93-b721-4fcc-83ca-788476058207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29508b93-b721-4fcc-83ca-788476058207', 'volume_size': 1} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:30 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec 1073741824" returned: 0 in 0.497s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:30 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec Nov 03 17:40:30 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (84efe3f1-9bea-4a66-9391-eba765def4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc36e1f-4e63-437b-b190-865ec856fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc36e1f-4e63-437b-b190-865ec856fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472602521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958bbead-1737-43b7-aa91-e0ddcdf3e681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fa0764-dfa9-497c-a4cb-f50bf5bbd6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fa0764-dfa9-497c-a4cb-f50bf5bbd6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4bf1c-1d04-4cae-8e78-be6e65dd19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4bf1c-1d04-4cae-8e78-be6e65dd19c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958bbead-1737-43b7-aa91-e0ddcdf3e681', 'volume_name': 'volume-958bbead-1737-43b7-aa91-e0ddcdf3e681', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001fd3af-2b6b-4b75-8d13-4cf245480085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001fd3af-2b6b-4b75-8d13-4cf245480085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7567687-b2f3-4d75-b547-75f1d7b74ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume 958bbead-1737-43b7-aa91-e0ddcdf3e681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958bbead-1737-43b7-aa91-e0ddcdf3e681', 'volume_size': 1} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:30 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155191671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29508b93-b721-4fcc-83ca-788476058207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume 29508b93-b721-4fcc-83ca-788476058207 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:30 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 1073741824 Nov 03 17:40:30 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59e4415-2de5-4267-b600-62d5942bbb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b14b5bf-46a5-478e-b68d-ecb67c724349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec (4279b87c-2a39-45d8-97df-7bd41cf8d8ec): created successfully Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b14b5bf-46a5-478e-b68d-ecb67c724349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (2a408cc7-8368-40ac-a072-102af90d19df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8b0546cc-896f-4885-ba95-ec53be14e4b6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (c0d1a8b4-004f-43de-acdd-a0c768365909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714c1866-55f0-4791-b997-4322ee6b1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714c1866-55f0-4791-b997-4322ee6b1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102443423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150e3557-560f-486c-a6e6-efb88daa275a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:31Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed21de5-a724-460e-98df-778d7ac3f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed21de5-a724-460e-98df-778d7ac3f087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72ce6cd-33e0-4208-a5b5-3dd1d5c7bf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72ce6cd-33e0-4208-a5b5-3dd1d5c7bf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150e3557-560f-486c-a6e6-efb88daa275a', 'volume_name': 'volume-150e3557-560f-486c-a6e6-efb88daa275a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5948aa75-7d2a-42c2-adee-21bae8be4fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5948aa75-7d2a-42c2-adee-21bae8be4fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80ae343-05fb-4c23-b10c-076559d38c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:30 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume 150e3557-560f-486c-a6e6-efb88daa275a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150e3557-560f-486c-a6e6-efb88daa275a', 'volume_size': 1} Nov 03 17:40:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:31 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 1073741824" returned: 0 in 0.512s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (4f47966c-0c66-423a-9a14-18ae3cef4254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80375cf-8015-4ee7-89fd-938bb02f2769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80375cf-8015-4ee7-89fd-938bb02f2769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1145681318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3687c866-ae60-4acf-bccf-ab7aa03f1a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:31Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552812a6-9f3b-4611-b172-7ae69efb8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552812a6-9f3b-4611-b172-7ae69efb8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a345813f-ceb8-4691-939f-e4609353a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a345813f-ceb8-4691-939f-e4609353a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3687c866-ae60-4acf-bccf-ab7aa03f1a75', 'volume_name': 'volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e1e080-3ffb-4996-849c-3a6418c829fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e1e080-3ffb-4996-849c-3a6418c829fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc99bf45-48dc-45ba-b1d6-2bcbbf8b20c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume 3687c866-ae60-4acf-bccf-ab7aa03f1a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75', 'volume_size': 1} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:31 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 Nov 03 17:40:31 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:31 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472602521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958bbead-1737-43b7-aa91-e0ddcdf3e681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:30Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume 958bbead-1737-43b7-aa91-e0ddcdf3e681 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:31 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:31 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 1073741824 Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8907884b-8361-4bfd-b78b-081322cb0d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29508b93-b721-4fcc-83ca-788476058207', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f9a47-eb2a-4d32-a80c-92b98216b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-29508b93-b721-4fcc-83ca-788476058207 (29508b93-b721-4fcc-83ca-788476058207): created successfully Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f9a47-eb2a-4d32-a80c-92b98216b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (a2109266-5a79-4271-9e11-1991629c258a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e63a6621-7e00-4668-a4a4-09b56579154f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:31 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 1073741824" returned: 0 in 0.414s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:31 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 Nov 03 17:40:31 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:32 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681" returned: 0 in 0.242s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102443423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150e3557-560f-486c-a6e6-efb88daa275a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:31Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume 150e3557-560f-486c-a6e6-efb88daa275a {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7567687-b2f3-4d75-b547-75f1d7b74ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958bbead-1737-43b7-aa91-e0ddcdf3e681', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:32 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a 1073741824 Nov 03 17:40:32 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7062ef21-e235-4f3b-9f58-901fbfad8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 (958bbead-1737-43b7-aa91-e0ddcdf3e681): created successfully Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7062ef21-e235-4f3b-9f58-901fbfad8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (84efe3f1-9bea-4a66-9391-eba765def4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d5397bea-0a94-4a11-a62b-1c53ba1d4b11 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:32 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a 1073741824" returned: 0 in 0.413s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:32 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a Nov 03 17:40:32 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:32 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a" returned: 0 in 0.235s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1145681318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3687c866-ae60-4acf-bccf-ab7aa03f1a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f319615494c547a59df00dc8a6c7448f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:31Z,use_quota=True,user_id='738fe20b80d2423b83ba68cefce4120b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Creating volume 3687c866-ae60-4acf-bccf-ab7aa03f1a75 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80ae343-05fb-4c23-b10c-076559d38c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150e3557-560f-486c-a6e6-efb88daa275a', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:32 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 1073741824 Nov 03 17:40:32 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f3bb99-ee20-48e7-9f28-6af4b398eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-150e3557-560f-486c-a6e6-efb88daa275a (150e3557-560f-486c-a6e6-efb88daa275a): created successfully Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f3bb99-ee20-48e7-9f28-6af4b398eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (c0d1a8b4-004f-43de-acdd-a0c768365909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0c51b1b2-995d-4283-aece-ba4d114c4658 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:33 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 1073741824" returned: 0 in 0.419s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:33 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 Nov 03 17:40:33 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:33 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75" returned: 0 in 0.251s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc99bf45-48dc-45ba-b1d6-2bcbbf8b20c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d3a40-a376-46a4-8218-dec03446b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:33 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Volume volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 (3687c866-ae60-4acf-bccf-ab7aa03f1a75): created successfully Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d3a40-a376-46a4-8218-dec03446b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:33 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Flow 'volume_create_manager' (4f47966c-0c66-423a-9a14-18ae3cef4254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d208fd73-3ad0-4160-bf77-a596568d21d8 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created volume successfully. Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-3687c866-ae60-4acf-bccf-ab7aa03f1a75-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-3687c866-ae60-4acf-bccf-ab7aa03f1a75-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-3687c866-ae60-4acf-bccf-ab7aa03f1a75" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-3687c866-ae60-4acf-bccf-ab7aa03f1a75" acquired by "delete_volume" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[32810b06-ab88-4975-b71d-05d493e3c2ca]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:34 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 Nov 03 17:40:34 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:34 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75" returned: 0 in 0.348s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:35 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75 Nov 03 17:40:35 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:35 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3687c866-ae60-4acf-bccf-ab7aa03f1a75" returned: 0 in 0.236s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-3687c866-ae60-4acf-bccf-ab7aa03f1a75" released by "delete_volume" :: held 0.620s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['c531173d-3fda-47b6-96bd-2388259c49e6', '61952b08-0613-4f33-86db-3d99b99b42ae', '73f41f3b-07c1-47e4-b531-f700807a0654', '60a072fb-70cb-4f93-b616-b783dae2a0c6'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:35 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:35 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:35 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.242s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42b60452-b703-4eff-8362-a950aafae76b tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-3687c866-ae60-4acf-bccf-ab7aa03f1a75-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-150e3557-560f-486c-a6e6-efb88daa275a-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-150e3557-560f-486c-a6e6-efb88daa275a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-150e3557-560f-486c-a6e6-efb88daa275a" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-150e3557-560f-486c-a6e6-efb88daa275a" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36bb0fe-099d-4bee-bbe6-668ecb52692d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:35 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a Nov 03 17:40:35 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:36 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a" returned: 0 in 0.345s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:36 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a Nov 03 17:40:36 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:36 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-150e3557-560f-486c-a6e6-efb88daa275a" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-150e3557-560f-486c-a6e6-efb88daa275a" released by "delete_volume" :: held 0.638s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['c9864768-4000-4147-ba25-7bf729b4e3a3', 'a4a2f2e8-c885-471e-9e71-e302a6e10746', '6aa45fb5-c43c-46eb-933a-a08cc760d54a', '0a884f15-5c5c-42ce-9a62-7b886108373a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:36 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:36 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:36 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.236s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b591987a-e7aa-44e3-879f-3d1f8f61fa9f tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-150e3557-560f-486c-a6e6-efb88daa275a-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-958bbead-1737-43b7-aa91-e0ddcdf3e681-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-958bbead-1737-43b7-aa91-e0ddcdf3e681-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-958bbead-1737-43b7-aa91-e0ddcdf3e681" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-958bbead-1737-43b7-aa91-e0ddcdf3e681" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1a8d2-000a-47a7-92fb-1487ea0042b3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:37 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 Nov 03 17:40:37 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:37 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681" returned: 0 in 0.376s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:37 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681 Nov 03 17:40:37 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:37 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-958bbead-1737-43b7-aa91-e0ddcdf3e681" returned: 0 in 0.256s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-958bbead-1737-43b7-aa91-e0ddcdf3e681" released by "delete_volume" :: held 0.671s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['3fccf9cf-8342-40cc-9d53-6853806a5e92', '700cf612-6451-4c05-890e-d1a808748feb', 'ccde201c-8e93-4ff0-9b01-cd380cae0cd1', '23a141e3-9a41-4f3f-b646-ae0dd6243203'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:37 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:37 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:37 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.237s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:37 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b158ba6b-9aff-48a1-a804-071c81cf4ca6 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-958bbead-1737-43b7-aa91-e0ddcdf3e681-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-29508b93-b721-4fcc-83ca-788476058207-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-29508b93-b721-4fcc-83ca-788476058207-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-29508b93-b721-4fcc-83ca-788476058207" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-29508b93-b721-4fcc-83ca-788476058207" acquired by "delete_volume" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb4cb51-1bea-4dc9-9027-29f8def8b187]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:38 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 Nov 03 17:40:38 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:38 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207" returned: 0 in 0.344s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:38 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207 Nov 03 17:40:38 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:38 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-29508b93-b721-4fcc-83ca-788476058207" returned: 0 in 0.232s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-29508b93-b721-4fcc-83ca-788476058207" released by "delete_volume" :: held 0.614s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['b02cc598-2ca7-4501-9a24-4757d4949fd9', '82d7533c-8c7b-47c9-9bf9-b5236991a3bd', 'a7af6f46-92ca-4aa0-92c5-d2607daf2342', '3cd9719b-b80c-4e8e-889a-4fea59099677'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:38 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:38 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:38 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:38 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:39 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.241s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-71b36a6d-3af5-43a1-b971-ac43582d2a33 tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-29508b93-b721-4fcc-83ca-788476058207-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:39 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.263s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-4279b87c-2a39-45d8-97df-7bd41cf8d8ec-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-4279b87c-2a39-45d8-97df-7bd41cf8d8ec-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" acquired by "delete_volume" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2cda41-42b1-4df9-bc97-d669c810a1d6]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:39 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec Nov 03 17:40:39 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:39 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" returned: 0 in 0.334s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:39 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec Nov 03 17:40:39 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:39 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" returned: 0 in 0.231s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-4279b87c-2a39-45d8-97df-7bd41cf8d8ec" released by "delete_volume" :: held 0.602s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['b93bf457-b9a5-4c46-a645-c65e0b41cdfa', 'cb976201-af40-48cf-9f5c-005e2ba673c5', '90c33da9-3540-4d67-9499-0e4e6f04ae77', '6f6ef65f-e391-42f6-83e1-ed6b343ec8ec'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:40 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:40 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:40 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.229s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-38da4752-ebb2-47d1-b29b-55d47093899a tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-4279b87c-2a39-45d8-97df-7bd41cf8d8ec-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-a2f7cdaf-0d19-440f-8f0a-5249012dd23b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-a2f7cdaf-0d19-440f-8f0a-5249012dd23b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "cinder-quobyte-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4ec2e-a13a-4476-9aeb-c2cb2bea5099]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:40 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b Nov 03 17:40:40 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:40 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" returned: 0 in 0.356s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:40 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b Nov 03 17:40:40 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:41 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" returned: 0 in 0.237s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-quobyte-a2f7cdaf-0d19-440f-8f0a-5249012dd23b" released by "delete_volume" :: held 0.633s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Created reservations ['8d8b9f03-6cb6-4dda-823f-48d9282e7591', 'ac505122-30d1-493b-8e06-4a7b6d23f541', '70c15b2d-3f7e-48c7-8a85-d1c0f0d25d08', '74ac99f9-5cad-4f5d-ab04-715e97c44460'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:41 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:40:41 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:41 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.233s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:40:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Deleted volume successfully. Nov 03 17:40:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bf433568-89df-453d-bccd-101e4880ad5e tempest-CreateVolumesFromSourceVolumeTest-1076701197 None] Lock "cinder-a2f7cdaf-0d19-440f-8f0a-5249012dd23b-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:40:51 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=43,cinder:INSERT=14,cinder:UPDATE=67,cinder:DELETE=6 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:40:51 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=65,cinder:SELECT=41,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (2c1ad859-d81b-4e73-a214-3819c89ef5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187b0bd-2e61-4fe1-8c61-a557b7b13f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187b0bd-2e61-4fe1-8c61-a557b7b13f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1682703809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a2e9d7-94f2-4c50-98c2-68199cca9d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09da0a5e-4d40-48fd-b9a0-bc9107485238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09da0a5e-4d40-48fd-b9a0-bc9107485238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e67a8-6f04-4470-a2a7-0ee200912b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e67a8-6f04-4470-a2a7-0ee200912b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a2e9d7-94f2-4c50-98c2-68199cca9d19', 'volume_name': 'volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc607479-09bd-4671-a0ca-78e197d03f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc607479-09bd-4671-a0ca-78e197d03f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7d9d26-8c42-4f0d-84c1-0fcc7736b479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:53 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Volume c1a2e9d7-94f2-4c50-98c2-68199cca9d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19', 'volume_size': 1} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1682703809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a2e9d7-94f2-4c50-98c2-68199cca9d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Creating volume c1a2e9d7-94f2-4c50-98c2-68199cca9d19 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:53 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:54 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 1073741824 Nov 03 17:40:54 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (556fec85-827e-4f3a-a51e-43e223472657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386ba50d-db12-4b36-8fe9-77de468a9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386ba50d-db12-4b36-8fe9-77de468a9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-100118428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd29f96b-a490-4c50-a76e-a1c27c540cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16846d-7a48-4988-b002-d7c26f8b1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16846d-7a48-4988-b002-d7c26f8b1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69333a7-1368-4357-afec-34dfc2dc2783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69333a7-1368-4357-afec-34dfc2dc2783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd29f96b-a490-4c50-a76e-a1c27c540cf9', 'volume_name': 'volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cb5bbf-3c29-44e4-b74d-f969c6ee7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cb5bbf-3c29-44e4-b74d-f969c6ee7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e82bf83-2261-4b07-b2ec-686982c8cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume bd29f96b-a490-4c50-a76e-a1c27c540cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9', 'volume_size': 1} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (e690108e-d7c8-49b8-bf4d-7e8fb7678bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80be08-44f1-4148-a482-67dbd360b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80be08-44f1-4148-a482-67dbd360b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1845274050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b2ffe-d7c0-4b15-aa64-03886346974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ac7161-33ea-486a-9dde-0860d37d6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ac7161-33ea-486a-9dde-0860d37d6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc08b27-20e6-4581-bc5e-0b28f8a40534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc08b27-20e6-4581-bc5e-0b28f8a40534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2b2ffe-d7c0-4b15-aa64-03886346974d', 'volume_name': 'volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157a27cd-97ea-4ff9-8825-95acec8e00cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157a27cd-97ea-4ff9-8825-95acec8e00cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87a66e-0651-4edc-83d5-2248d2bd92c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Volume 0e2b2ffe-d7c0-4b15-aa64-03886346974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d', 'volume_size': 1} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:54 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (572acad9-f3e6-4277-84fb-7918664f0ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d985dde-9865-4749-9cb6-d38ce782d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 1073741824" returned: 0 in 0.954s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d985dde-9865-4749-9cb6-d38ce782d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725154396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a9755e-f6f8-442c-acfc-89fae42170b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db233adb-5489-4e99-a93b-5000ff5f182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db233adb-5489-4e99-a93b-5000ff5f182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cee9c10-7804-464f-bfc8-cdd935fb2a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cee9c10-7804-464f-bfc8-cdd935fb2a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a9755e-f6f8-442c-acfc-89fae42170b2', 'volume_name': 'volume-48a9755e-f6f8-442c-acfc-89fae42170b2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063bf3ea-cf0c-4001-a4d1-6d1f25e37822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063bf3ea-cf0c-4001-a4d1-6d1f25e37822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:54 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8395d4ac-70b6-453a-bbcf-7a65823cc7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Volume 48a9755e-f6f8-442c-acfc-89fae42170b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a9755e-f6f8-442c-acfc-89fae42170b2', 'volume_size': 1} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (64f2a4b2-c10c-4c91-b6d6-182c10a22131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a5d61b-46b3-4c1f-8e4e-35d23a1133d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a5d61b-46b3-4c1f-8e4e-35d23a1133d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147162331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d22c1b-cc00-498f-9868-611f8e68e0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cf6c11-dbe0-4ff9-aeca-75a176b43dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cf6c11-dbe0-4ff9-aeca-75a176b43dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea02fa-ee29-476e-9dbb-876901b3c575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea02fa-ee29-476e-9dbb-876901b3c575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d22c1b-cc00-498f-9868-611f8e68e0d2', 'volume_name': 'volume-80d22c1b-cc00-498f-9868-611f8e68e0d2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6176b94-1a4d-4c6c-90c2-74384d88ec96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6176b94-1a4d-4c6c-90c2-74384d88ec96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce92f72-e071-4195-87ca-b84bca4a8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Volume 80d22c1b-cc00-498f-9868-611f8e68e0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d22c1b-cc00-498f-9868-611f8e68e0d2', 'volume_size': 1} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:55 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 Nov 03 17:40:55 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (29f43938-6ce7-4faa-beb0-a4a03273ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8555a4a6-78e3-455c-ac64-bafcaaa929f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8555a4a6-78e3-455c-ac64-bafcaaa929f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439482455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9569b0e-c013-4dc0-ba61-57cea7bea47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df436b83-6975-4bb2-9f95-06989254d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df436b83-6975-4bb2-9f95-06989254d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed04b0c1-0864-48f5-a74c-471ba0ffe830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed04b0c1-0864-48f5-a74c-471ba0ffe830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9569b0e-c013-4dc0-ba61-57cea7bea47b', 'volume_name': 'volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c1ac97-f827-4704-994c-12c590182bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c1ac97-f827-4704-994c-12c590182bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d11b7-becc-4bce-a345-3496bebec620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Volume c9569b0e-c013-4dc0-ba61-57cea7bea47b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b', 'volume_size': 1} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:55 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" returned: 0 in 0.338s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-100118428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd29f96b-a490-4c50-a76e-a1c27c540cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7d9d26-8c42-4f0d-84c1-0fcc7736b479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 1073741824 Nov 03 17:40:55 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6469f19f-7d9a-4638-b47d-724ac878f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Volume volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 (c1a2e9d7-94f2-4c50-98c2-68199cca9d19): created successfully Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6469f19f-7d9a-4638-b47d-724ac878f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (2c1ad859-d81b-4e73-a214-3819c89ef5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-82d17c87-f01b-4687-8bd3-73f9982afb1a tempest-CreateVolumesFromImageTest-1643034919 None] Created volume successfully. Nov 03 17:40:56 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 1073741824" returned: 0 in 0.515s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:56 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 Nov 03 17:40:56 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:56 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9" returned: 0 in 0.307s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1845274050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b2ffe-d7c0-4b15-aa64-03886346974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:54Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Creating volume 0e2b2ffe-d7c0-4b15-aa64-03886346974d {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:56 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e82bf83-2261-4b07-b2ec-686982c8cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6fb27e-cb22-4c4b-8757-ad945a6e6485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:56 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d 1073741824 Nov 03 17:40:56 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 (bd29f96b-a490-4c50-a76e-a1c27c540cf9): created successfully Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6fb27e-cb22-4c4b-8757-ad945a6e6485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (556fec85-827e-4f3a-a51e-43e223472657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d71df3e7-8f95-447e-999c-a739d2388390 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Flow 'volume_create_manager' (f19d7de1-489d-4815-b0ee-3abbea7f530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff4a92-47a5-4eef-969f-d6661eb619f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff4a92-47a5-4eef-969f-d6661eb619f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75592922-1b08-4840-8f9c-da0fad46fba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13263707ef254a9e9514f0d316d2ece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:57Z,use_quota=True,user_id='829ea2b13f4b4e19a9f876f91423f794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545c1c7f-5664-4c5e-a124-1a59827b77ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545c1c7f-5664-4c5e-a124-1a59827b77ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdf0006-e02e-4762-a52f-ac10937f536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:40:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:57 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d 1073741824" returned: 0 in 0.616s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:57 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d Nov 03 17:40:57 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdf0006-e02e-4762-a52f-ac10937f536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75592922-1b08-4840-8f9c-da0fad46fba5', 'volume_name': 'volume-75592922-1b08-4840-8f9c-da0fad46fba5', 'volume_size': 1, 'image_id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a88f563aaa7315524697ca62fc616905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13263707ef254a9e9514f0d316d2ece4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b85d65659d392047f0c637278d2080ab120d5192a857c32ca49e1628d7ced299a55009da06af6672edf3048e37fad307e393d43cc51226077b043c6c1900fecc', 'id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a78338d7-4984-4cd8-9d79-44ddff543dd0/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8eb6cb-175e-466e-a1c9-6c9c8df6d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8eb6cb-175e-466e-a1c9-6c9c8df6d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2aeffb-1b14-427e-8a0d-3d8e673b7c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Volume 75592922-1b08-4840-8f9c-da0fad46fba5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75592922-1b08-4840-8f9c-da0fad46fba5', 'volume_size': 1, 'image_id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a88f563aaa7315524697ca62fc616905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13263707ef254a9e9514f0d316d2ece4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b85d65659d392047f0c637278d2080ab120d5192a857c32ca49e1628d7ced299a55009da06af6672edf3048e37fad307e393d43cc51226077b043c6c1900fecc', 'id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a78338d7-4984-4cd8-9d79-44ddff543dd0/file', 'properties': {}}, 'image_service': } Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Trying to clone 75592922-1b08-4840-8f9c-da0fad46fba5 from image a78338d7-4984-4cd8-9d79-44ddff543dd0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:40:57 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725154396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a9755e-f6f8-442c-acfc-89fae42170b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Creating volume 48a9755e-f6f8-442c-acfc-89fae42170b2 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:57 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:40:57 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:40:57 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 1073741824 Nov 03 17:40:57 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87a66e-0651-4edc-83d5-2248d2bd92c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3ad01a-d7cb-4ec3-a9a1-43c98ba54a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Volume volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d (0e2b2ffe-d7c0-4b15-aa64-03886346974d): created successfully Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3ad01a-d7cb-4ec3-a9a1-43c98ba54a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (e690108e-d7c8-49b8-bf4d-7e8fb7678bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b08b6-e44c-4482-8fc0-aa9750c9c8e6]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c21511b6-acf2-4146-8521-85fdd42f772c tempest-CreateVolumesFromImageTest-1643034919 None] Created volume successfully. Nov 03 17:40:57 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:40:57 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:57 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:57 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 1073741824" returned: 0 in 0.610s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:58 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:40:58 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 Nov 03 17:40:58 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Flow 'volume_create_manager' (26884eeb-d8f2-4c19-b5a9-34165d9f9c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d114cac7-31cc-467d-a91a-b5b81e4d4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d114cac7-31cc-467d-a91a-b5b81e4d4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b68b767-45db-499d-8757-1d3bd1cb3f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6463577842ed40a3bf4a7460139f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:58Z,use_quota=True,user_id='db77e8ad3d3f46768ab60282ed0168ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87ecc68e-b1b3-4465-aa82-83772f459cee),volume_type_id=87ecc68e-b1b3-4465-aa82-83772f459cee)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc199e1-de50-4c9e-8066-3afd4f074a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc199e1-de50-4c9e-8066-3afd4f074a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f47db29-dba1-4b8a-9f17-754827715133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.image.glance [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Creating Keystone auth plugin from conf {{(pid=86995) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:40:58 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Temporary image a78338d7-4984-4cd8-9d79-44ddff543dd0 is fetched for user 829ea2b13f4b4e19a9f876f91423f794. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:40:58 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.176s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147162331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d22c1b-cc00-498f-9868-611f8e68e0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Creating volume 80d22c1b-cc00-498f-9868-611f8e68e0d2 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:58 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 1073741824 Nov 03 17:40:58 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8395d4ac-70b6-453a-bbcf-7a65823cc7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a9755e-f6f8-442c-acfc-89fae42170b2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04f42c8-12ef-48e2-8b58-31e24c6c0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Volume volume-48a9755e-f6f8-442c-acfc-89fae42170b2 (48a9755e-f6f8-442c-acfc-89fae42170b2): created successfully Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04f42c8-12ef-48e2-8b58-31e24c6c0dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (572acad9-f3e6-4277-84fb-7918664f0ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c662b906-7287-4082-aaa0-7a985c1d1dbe]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c18c17a0-4de1-4ca3-95c8-ae7157c44ed0 tempest-CreateVolumesFromImageTest-1643034919 None] Created volume successfully. Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f47db29-dba1-4b8a-9f17-754827715133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b68b767-45db-499d-8757-1d3bd1cb3f75', 'volume_name': 'volume-9b68b767-45db-499d-8757-1d3bd1cb3f75', 'volume_size': 1, 'image_id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33a121400d84a82413aa231bd7aaa793', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6463577842ed40a3bf4a7460139f71c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a9c9cc523e9be26d9f4bb18f4a56690010f99d414b71803e38eeb03076a13ce1fd404d32e6c667e98b037468b9343d40c5297f0ec17049ed1b52d190fca8c5', 'id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2f99e6-c8be-43b4-aed5-0c9669b5ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2f99e6-c8be-43b4-aed5-0c9669b5ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94f2f75-6c94-4a87-9a66-b356681750fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Volume 9b68b767-45db-499d-8757-1d3bd1cb3f75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b68b767-45db-499d-8757-1d3bd1cb3f75', 'volume_size': 1, 'image_id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33a121400d84a82413aa231bd7aaa793', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6463577842ed40a3bf4a7460139f71c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a9c9cc523e9be26d9f4bb18f4a56690010f99d414b71803e38eeb03076a13ce1fd404d32e6c667e98b037468b9343d40c5297f0ec17049ed1b52d190fca8c5', 'id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Trying to clone 9b68b767-45db-499d-8757-1d3bd1cb3f75 from image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 at location (None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}]). {{(pid=86995) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:40:58 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:40:58 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:40:58 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5af192-629c-4f9a-8e05-40ab9bf097bd]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:40:58 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:58 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 1073741824" returned: 0 in 0.558s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:58 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 Nov 03 17:40:58 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:40:59 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:59 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:40:59 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.843s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439482455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9569b0e-c013-4dc0-ba61-57cea7bea47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fdc5cf0e8f485a9ca808e3f5f4c278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:55Z,use_quota=True,user_id='825c7bd7a63d4dffbcd2c2c63ebcdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Creating volume c9569b0e-c013-4dc0-ba61-57cea7bea47b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:40:59 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:59 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce92f72-e071-4195-87ca-b84bca4a8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d22c1b-cc00-498f-9868-611f8e68e0d2', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:59 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b 1073741824 Nov 03 17:40:59 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f88273-5b2d-47eb-ad7a-129b60b6f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:40:59 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Volume volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 (80d22c1b-cc00-498f-9868-611f8e68e0d2): created successfully Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f88273-5b2d-47eb-ad7a-129b60b6f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (64f2a4b2-c10c-4c91-b6d6-182c10a22131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:40:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ecb540f4-eb35-4714-81e8-f6f8efca6347 tempest-CreateVolumesFromImageTest-1643034919 None] Created volume successfully. Nov 03 17:40:59 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Temporary image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 is fetched for user db77e8ad3d3f46768ab60282ed0168ed. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a9cc7-825c-463b-80e9-20ac282d966c]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:59 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:40:59 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b 1073741824" returned: 0 in 0.476s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:40:59 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b Nov 03 17:40:59 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:40:59 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:40:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:00 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:41:00 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:00 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.096s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d11b7-becc-4bce-a345-3496bebec620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21341daa-4e03-4684-af2a-59a0f60d3999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating offline snapshot 24dd7aa7-b325-4beb-8584-babaf074a996 of volume bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:00 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Volume volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b (c9569b0e-c013-4dc0-ba61-57cea7bea47b): created successfully Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21341daa-4e03-4684-af2a-59a0f60d3999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Flow 'volume_create_manager' (29f43938-6ce7-4faa-beb0-a4a03273ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ceca0d-544e-41fe-940b-7b33096bb129]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0e7a250a-4fe3-410a-a1f3-e994f092b700 tempest-CreateVolumesFromImageTest-1643034919 None] Created volume successfully. Nov 03 17:41:00 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 Nov 03 17:41:00 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:00 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:00 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:00 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 1G Nov 03 17:41:00 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:00 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 1G" returned: 0 in 0.443s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-c9569b0e-c013-4dc0-ba61-57cea7bea47b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:00 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 Nov 03 17:41:00 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-c9569b0e-c013-4dc0-ba61-57cea7bea47b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-quobyte-c9569b0e-c013-4dc0-ba61-57cea7bea47b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-c9569b0e-c013-4dc0-ba61-57cea7bea47b" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a26482-6eb8-485e-a216-e20c6294e11e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b Nov 03 17:41:01 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:01 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:01 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 is being set with open permissions: ugo+rw Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 Nov 03 17:41:01 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:01 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b" returned: 0 in 0.404s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b Nov 03 17:41:01 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:01 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996" returned: 0 in 0.280s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info Nov 03 17:41:01 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:01 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c9569b0e-c013-4dc0-ba61-57cea7bea47b" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-c9569b0e-c013-4dc0-ba61-57cea7bea47b" released by "delete_volume" :: held 0.739s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Created reservations ['d77077e5-1074-4ce7-b39b-06f8a65d49ed', '28b84d7c-0d12-4fc2-86a7-5fd4d9f85c3a', '00a2ae16-eea5-46ea-866f-3b995f477cc0', 'ce01f4ca-453e-407f-bf7a-9313170de816'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:01 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:01 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info is being set with open permissions: ugo+rw Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info Nov 03 17:41:01 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:01 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:01 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-80d22c1b-cc00-498f-9868-611f8e68e0d2-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:02 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.info" returned: 0 in 0.311s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.932s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75592922-1b08-4840-8f9c-da0fad46fba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13263707ef254a9e9514f0d316d2ece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:57Z,use_quota=True,user_id='829ea2b13f4b4e19a9f876f91423f794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Creating volume 75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:02 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:02 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:02 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1073741824 Nov 03 17:41:02 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-80d22c1b-cc00-498f-9868-611f8e68e0d2-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.340s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Deleted volume successfully. Nov 03 17:41:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2f9aa98a-14cc-459a-892c-7a54b4e44724 tempest-CreateVolumesFromSnapshotTest-612416928 None] Create snapshot completed successfully Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e735ac23-3f92-4e86-9c63-0802bd0eaab6 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-c9569b0e-c013-4dc0-ba61-57cea7bea47b-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-quobyte-80d22c1b-cc00-498f-9868-611f8e68e0d2" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-80d22c1b-cc00-498f-9868-611f8e68e0d2" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651ed91-75f8-4e6d-b95f-a848567dd1ef]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:02 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 Nov 03 17:41:02 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:02 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1073741824" returned: 0 in 0.529s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:02 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2" returned: 0 in 0.423s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:02 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2 Nov 03 17:41:02 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:02 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 Nov 03 17:41:02 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:03 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:03 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b68b767-45db-499d-8757-1d3bd1cb3f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6463577842ed40a3bf4a7460139f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:40:58Z,use_quota=True,user_id='db77e8ad3d3f46768ab60282ed0168ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87ecc68e-b1b3-4465-aa82-83772f459cee),volume_type_id=87ecc68e-b1b3-4465-aa82-83772f459cee)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Creating volume 9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:03 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-80d22c1b-cc00-498f-9868-611f8e68e0d2" returned: 0 in 0.318s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:03 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1073741824 Nov 03 17:41:03 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-80d22c1b-cc00-498f-9868-611f8e68e0d2" released by "delete_volume" :: held 0.794s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Attempting download of a78338d7-4984-4cd8-9d79-44ddff543dd0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}])) to volume 75592922-1b08-4840-8f9c-da0fad46fba5. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a53c0-d1ab-4029-8355-5d1480a4b078]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Created reservations ['24cda1fe-cd09-4567-bf69-7bb057d59125', '4d35a7b9-b75b-4b0e-8a52-daaa37742bad', 'b87ce2d8-4e82-489d-aef3-58e7f201f969', '759460b8-f2ce-4a3d-9773-b62ede7a8922'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:03 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak Nov 03 17:41:03 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:03 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:03 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:03 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Deleted volume successfully. Nov 03 17:41:03 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:03 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4001c6fb-deb8-407b-b507-27f1a1782864 tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-80d22c1b-cc00-498f-9868-611f8e68e0d2-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1073741824" returned: 0 in 0.769s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:03 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 Nov 03 17:41:03 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:03 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak Nov 03 17:41:03 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (dce078eb-40e1-498a-a37a-9e12650d1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3751b-0db0-4f01-8a30-7f9e8a93b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3751b-0db0-4f01-8a30-7f9e8a93b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426316059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca70c65-4769-48ad-8b0a-a83bc9e47bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:04Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c47b49b-f6d8-4b13-b2cd-a0a047f37702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c47b49b-f6d8-4b13-b2cd-a0a047f37702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e8ccfe-6bba-4f40-aba5-6ea134db8dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e8ccfe-6bba-4f40-aba5-6ea134db8dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca70c65-4769-48ad-8b0a-a83bc9e47bb1', 'volume_name': 'volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ca7d7-e542-421c-ad40-a319ed49ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ca7d7-e542-421c-ad40-a319ed49ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6677598e-fbbf-459a-99b6-8276e29d4117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume 4ca70c65-4769-48ad-8b0a-a83bc9e47bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1', 'volume_size': 1} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75" returned: 0 in 0.387s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426316059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca70c65-4769-48ad-8b0a-a83bc9e47bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:04Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume 4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:04 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:04 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak" returned: 1 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a78338d7-4984-4cd8-9d79-44ddff543dd0_cpnhn8ak' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f14678-0b47-46ff-a190-0c93e05b0fc9]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:04 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 1073741824 Nov 03 17:41:04 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Attempting download of 401588dd-bd5f-48ff-9bc0-fcb1a917f939 ((None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}])) to volume 9b68b767-45db-499d-8757-1d3bd1cb3f75. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-48a9755e-f6f8-442c-acfc-89fae42170b2-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[969071e9-d493-4d5d-9715-5d81295c65e8]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (d144f0bc-c9d1-4138-9c39-07e85ae2ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8d9b64-b6bc-43d2-be53-3508e69480a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-48a9755e-f6f8-442c-acfc-89fae42170b2-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:04 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:41:04 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09 Nov 03 17:41:04 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:04 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8d9b64-b6bc-43d2-be53-3508e69480a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16719013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e48f6-4d07-4f55-bbf3-bb3f53319e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:04Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a18a7a2-6f8e-4a67-b224-708f7154f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a18a7a2-6f8e-4a67-b224-708f7154f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670ea8e4-62a7-4a58-a2e1-415a56a87493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670ea8e4-62a7-4a58-a2e1-415a56a87493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6e48f6-4d07-4f55-bbf3-bb3f53319e02', 'volume_name': 'volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb39af8-53ff-4d37-bd5b-a990f700efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb39af8-53ff-4d37-bd5b-a990f700efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042a101b-3d56-496f-9dc5-30494fd5cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:04 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume 8f6e48f6-4d07-4f55-bbf3-bb3f53319e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02', 'volume_size': 1} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-quobyte-48a9755e-f6f8-442c-acfc-89fae42170b2" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-48a9755e-f6f8-442c-acfc-89fae42170b2" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efeebcc-63c2-4da0-9184-044714ac89ad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:04 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09" returned: 0 in 0.442s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 Nov 03 17:41:05 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 1073741824" returned: 0 in 0.821s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09 Nov 03 17:41:05 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 Nov 03 17:41:05 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD Nov 03 17:41:05 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (3d452d91-4d4a-4452-bf8e-b744d7fb3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:05 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b410e59-a012-4d58-bbb3-4fd413d5de8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2" returned: 0 in 0.620s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b410e59-a012-4d58-bbb3-4fd413d5de8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-75480634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77517e60-af01-4f79-803a-81c6df7a155e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:05Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf69c0c-2d9e-4b19-9943-7b11fee40176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2 Nov 03 17:41:05 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf69c0c-2d9e-4b19-9943-7b11fee40176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c526c1-ec9f-4a89-bd43-48ea85ebc04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c526c1-ec9f-4a89-bd43-48ea85ebc04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77517e60-af01-4f79-803a-81c6df7a155e', 'volume_name': 'volume-77517e60-af01-4f79-803a-81c6df7a155e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40761fdf-914d-4500-9333-1e1bbe01fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40761fdf-914d-4500-9333-1e1bbe01fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20270d45-0177-4916-80ee-e0c4eb411d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume 77517e60-af01-4f79-803a-81c6df7a155e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77517e60-af01-4f79-803a-81c6df7a155e', 'volume_size': 1} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09" returned: 1 in 0.636s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_401588dd-bd5f-48ff-9bc0-fcb1a917f939_pbfcim09' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e5034-1c34-42f6-97a7-91da91c4cca7]: (4, 'raw') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16719013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e48f6-4d07-4f55-bbf3-bb3f53319e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:04Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume 8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:05 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:05 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 1073741824 Nov 03 17:41:05 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6677598e-fbbf-459a-99b6-8276e29d4117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37578a-b242-4cdd-a73d-bb78e7671c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] a78338d7-4984-4cd8-9d79-44ddff543dd0 was raw, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:05 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 (4ca70c65-4769-48ad-8b0a-a83bc9e47bb1): created successfully Nov 03 17:41:05 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:41:05 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 Nov 03 17:41:05 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37578a-b242-4cdd-a73d-bb78e7671c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:05 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (dce078eb-40e1-498a-a37a-9e12650d1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:05 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b2a9be96-b620-4652-be75-e7aa0747a9a5 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:41:06 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-48a9755e-f6f8-442c-acfc-89fae42170b2" returned: 0 in 0.593s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:06 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (8656545e-6a9b-4969-985a-2accea065d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb9cb85-45ea-448f-a4cc-092e39fb5558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb9cb85-45ea-448f-a4cc-092e39fb5558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915278823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71531ff5-caaa-4414-bada-59f04c1718d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:06Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0748215a-0512-4bb4-9d92-6a695d43181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0748215a-0512-4bb4-9d92-6a695d43181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f774c9b1-20b1-477e-b8d4-9f6a9704bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f774c9b1-20b1-477e-b8d4-9f6a9704bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71531ff5-caaa-4414-bada-59f04c1718d1', 'volume_name': 'volume-71531ff5-caaa-4414-bada-59f04c1718d1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f81fb5-043c-4f42-bdd0-3add17d435a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f81fb5-043c-4f42-bdd0-3add17d435a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73013e7-cfd3-4621-acea-af3a3c9efb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume 71531ff5-caaa-4414-bada-59f04c1718d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71531ff5-caaa-4414-bada-59f04c1718d1', 'volume_size': 1} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-48a9755e-f6f8-442c-acfc-89fae42170b2" released by "delete_volume" :: held 1.379s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Created reservations ['07f81311-f911-45d3-bfc4-5f9bdf64ce57', 'f3353dd8-8219-4dfd-936b-6f400150f297', '5d7054c2-e456-45e3-9862-840b8a303d03', '21578dc8-d422-4092-8b1f-4ee88dce32b0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:06 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:06 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:06 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:06 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:06 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 1073741824" returned: 0 in 0.821s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (a38e0a6f-e03f-44c5-bbba-1c79abc5d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248a6840-7653-461e-a9a6-3814e2adcb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5" returned: 0 in 0.844s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a78338d7-4984-4cd8-9d79-44ddff543dd0_bbdwaixydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:41:06 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:06 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1G Nov 03 17:41:06 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248a6840-7653-461e-a9a6-3814e2adcb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643450160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fb978e-450f-452b-b21b-b9b4be449bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:06Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f5106-6c31-4fef-8f5d-45d272321bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f5106-6c31-4fef-8f5d-45d272321bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d3c6e-4772-4b41-818c-22388d1d475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d3c6e-4772-4b41-818c-22388d1d475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fb978e-450f-452b-b21b-b9b4be449bb5', 'volume_name': 'volume-35fb978e-450f-452b-b21b-b9b4be449bb5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3124f82f-e692-4ffd-890c-20f23fb0d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3124f82f-e692-4ffd-890c-20f23fb0d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c08084-cae2-431b-b2c4-11f7c45caecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume 35fb978e-450f-452b-b21b-b9b4be449bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fb978e-450f-452b-b21b-b9b4be449bb5', 'volume_size': 1} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:06 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD" returned: 1 in 0.548s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] 401588dd-bd5f-48ff-9bc0-fcb1a917f939 was raw, converting to qcow2 {{(pid=86995) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:06 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 Nov 03 17:41:06 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:06 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 Nov 03 17:41:06 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:06 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.383s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Deleted volume successfully. Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f6c01db-7d33-4d50-a4c8-9d112327a70d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-48a9755e-f6f8-442c-acfc-89fae42170b2-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-0e2b2ffe-d7c0-4b15-aa64-03886346974d-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-0e2b2ffe-d7c0-4b15-aa64-03886346974d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-quobyte-0e2b2ffe-d7c0-4b15-aa64-03886346974d" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-0e2b2ffe-d7c0-4b15-aa64-03886346974d" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:07 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 1G" returned: 0 in 0.408s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Downloaded image a78338d7-4984-4cd8-9d79-44ddff543dd0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}])) to volume 75592922-1b08-4840-8f9c-da0fad46fba5 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Temporary image a78338d7-4984-4cd8-9d79-44ddff543dd0 for user 829ea2b13f4b4e19a9f876f91423f794 is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Marking volume 75592922-1b08-4840-8f9c-da0fad46fba5 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f98a73-c76d-4e3e-b5c6-97b7abbec591]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Copying metadata from image a78338d7-4984-4cd8-9d79-44ddff543dd0 to 75592922-1b08-4840-8f9c-da0fad46fba5. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Creating volume glance metadata for volume 75592922-1b08-4840-8f9c-da0fad46fba5 backed by image a78338d7-4984-4cd8-9d79-44ddff543dd0 with: {'image_id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a88f563aaa7315524697ca62fc616905', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:41:07 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-75480634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77517e60-af01-4f79-803a-81c6df7a155e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:05Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume 77517e60-af01-4f79-803a-81c6df7a155e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042a101b-3d56-496f-9dc5-30494fd5cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:07 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e 1073741824 Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05b5c60-45d2-4741-9012-79a954f24641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:07 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 (8f6e48f6-4d07-4f55-bbf3-bb3f53319e02): created successfully Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05b5c60-45d2-4741-9012-79a954f24641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (d144f0bc-c9d1-4138-9c39-07e85ae2ac63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:07 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d Nov 03 17:41:07 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9bf939a0-36c5-4b3b-bc51-97d83ccc5ae4 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2aeffb-1b14-427e-8a0d-3d8e673b7c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75592922-1b08-4840-8f9c-da0fad46fba5', 'volume_size': 1, 'image_id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a78338d7-4984-4cd8-9d79-44ddff543dd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a88f563aaa7315524697ca62fc616905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13263707ef254a9e9514f0d316d2ece4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b85d65659d392047f0c637278d2080ab120d5192a857c32ca49e1628d7ced299a55009da06af6672edf3048e37fad307e393d43cc51226077b043c6c1900fecc', 'id': 'a78338d7-4984-4cd8-9d79-44ddff543dd0', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a78338d7-4984-4cd8-9d79-44ddff543dd0/file', 'properties': {}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cc9e5f-7e1d-4176-bd6c-8887d9883d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Volume volume-75592922-1b08-4840-8f9c-da0fad46fba5 (75592922-1b08-4840-8f9c-da0fad46fba5): created successfully Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cc9e5f-7e1d-4176-bd6c-8887d9883d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Flow 'volume_create_manager' (f19d7de1-489d-4815-b0ee-3abbea7f530b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2b35c267-b2ef-432c-9edc-f39290463b6d tempest-VolumeImageDependencyTests-301932444 None] Created volume successfully. Nov 03 17:41:07 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75" returned: 0 in 0.622s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_401588dd-bd5f-48ff-9bc0-fcb1a917f939_7pqvohdxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:41:07 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1G Nov 03 17:41:07 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d" returned: 0 in 0.461s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d Nov 03 17:41:07 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Acquiring lock "cinder-75592922-1b08-4840-8f9c-da0fad46fba5-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:07 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "cinder-75592922-1b08-4840-8f9c-da0fad46fba5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e 1073741824" returned: 0 in 0.597s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Acquiring lock "cinder-quobyte-75592922-1b08-4840-8f9c-da0fad46fba5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "cinder-quobyte-75592922-1b08-4840-8f9c-da0fad46fba5" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:07 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e Nov 03 17:41:07 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9da88-4cc0-4a4f-9360-849e4bbafc9d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:07 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 1G" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Downloaded image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 ((None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}])) to volume 9b68b767-45db-499d-8757-1d3bd1cb3f75 successfully. {{(pid=86995) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Temporary image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 for user db77e8ad3d3f46768ab60282ed0168ed is deleted. {{(pid=86995) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.volume_utils [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Marking volume 9b68b767-45db-499d-8757-1d3bd1cb3f75 as bootable. {{(pid=86995) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:41:07 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0e2b2ffe-d7c0-4b15-aa64-03886346974d" returned: 0 in 0.350s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Copying metadata from image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 to 9b68b767-45db-499d-8757-1d3bd1cb3f75. {{(pid=86995) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Creating volume glance metadata for volume 9b68b767-45db-499d-8757-1d3bd1cb3f75 backed by image 401588dd-bd5f-48ff-9bc0-fcb1a917f939 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '33a121400d84a82413aa231bd7aaa793', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86995) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-0e2b2ffe-d7c0-4b15-aa64-03886346974d" released by "delete_volume" :: held 0.867s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:07 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 Nov 03 17:41:07 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:07 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Created reservations ['a3648445-ed13-4522-a150-22f5ee85e2aa', '3778612d-954b-40da-af7e-5c155e9f10d6', '10da5fd2-995d-409d-89e7-d5ded62f39a9', '496e47a8-ecc8-465d-b161-9e17abbb614a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94f2f75-6c94-4a87-9a66-b356681750fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b68b767-45db-499d-8757-1d3bd1cb3f75', 'volume_size': 1, 'image_id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33a121400d84a82413aa231bd7aaa793', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6463577842ed40a3bf4a7460139f71c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a9c9cc523e9be26d9f4bb18f4a56690010f99d414b71803e38eeb03076a13ce1fd404d32e6c667e98b037468b9343d40c5297f0ec17049ed1b52d190fca8c5', 'id': '401588dd-bd5f-48ff-9bc0-fcb1a917f939', 'created_at': datetime.datetime(2026, 11, 3, 16, 40, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 40, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/401588dd-bd5f-48ff-9bc0-fcb1a917f939/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca7f87-ed8c-41d6-9b5e-b13c138460bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Volume volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 (9b68b767-45db-499d-8757-1d3bd1cb3f75): created successfully Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca7f87-ed8c-41d6-9b5e-b13c138460bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Flow 'volume_create_manager' (26884eeb-d8f2-4c19-b5a9-34165d9f9c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:08 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f8fb85ec-9826-4d18-8dc3-a3b91ff54258 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Created volume successfully. Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915278823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71531ff5-caaa-4414-bada-59f04c1718d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:06Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume 71531ff5-caaa-4414-bada-59f04c1718d1 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20270d45-0177-4916-80ee-e0c4eb411d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77517e60-af01-4f79-803a-81c6df7a155e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9206993a-a84d-46e9-8eba-0a6a30adb829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:08 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 1073741824 Nov 03 17:41:08 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-c1a2e9d7-94f2-4c50-98c2-68199cca9d19-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-77517e60-af01-4f79-803a-81c6df7a155e (77517e60-af01-4f79-803a-81c6df7a155e): created successfully Nov 03 17:41:08 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:08 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9206993a-a84d-46e9-8eba-0a6a30adb829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (3d452d91-4d4a-4452-bf8e-b744d7fb3b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e526c208-9a72-489c-91ad-06e09668bb7c tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-c1a2e9d7-94f2-4c50-98c2-68199cca9d19-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "cinder-quobyte-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:08 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5" returned: 0 in 0.475s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:08 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5 Nov 03 17:41:08 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f21b41-ce63-4d24-9a30-1ec4a29c8484]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 Nov 03 17:41:08 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:08 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.351s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:08 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Deleted volume successfully. Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ecc135fe-981b-411a-9bd2-4c08e07d2a5d tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-0e2b2ffe-d7c0-4b15-aa64-03886346974d-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:08 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-75592922-1b08-4840-8f9c-da0fad46fba5" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "cinder-quobyte-75592922-1b08-4840-8f9c-da0fad46fba5" released by "delete_volume" :: held 0.923s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:08 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 1073741824" returned: 0 in 0.647s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Created reservations ['87745000-270d-4e81-8002-847f21cd561e', 'e9a369c0-7a95-4b29-8640-2c721f47eb38', '1fdd5e91-27b1-4c79-9e23-c84458e652a9', '67d70d24-5b9f-419e-b888-b1620df0de5d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 Nov 03 17:41:08 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:08 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" returned: 0 in 0.612s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:08 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:09 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19 Nov 03 17:41:09 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Acquiring lock "cinder-9b68b767-45db-499d-8757-1d3bd1cb3f75-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "cinder-9b68b767-45db-499d-8757-1d3bd1cb3f75-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Acquiring lock "cinder-quobyte-9b68b767-45db-499d-8757-1d3bd1cb3f75" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:09 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "cinder-quobyte-9b68b767-45db-499d-8757-1d3bd1cb3f75" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643450160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fb978e-450f-452b-b21b-b9b4be449bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dc9eadff9f43a6aac9a1211eb20efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:06Z,use_quota=True,user_id='87fc0b8c0516462789115ae8532ac97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Creating volume 35fb978e-450f-452b-b21b-b9b4be449bb5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:09 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c74d10e-acb6-4f14-b86b-e18be49fe64f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:09 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 1073741824 Nov 03 17:41:09 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73013e7-cfd3-4621-acea-af3a3c9efb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71531ff5-caaa-4414-bada-59f04c1718d1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4ab60a-7b2f-439d-b4b1-7aee74753941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:09 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-71531ff5-caaa-4414-bada-59f04c1718d1 (71531ff5-caaa-4414-bada-59f04c1718d1): created successfully Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4ab60a-7b2f-439d-b4b1-7aee74753941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (8656545e-6a9b-4969-985a-2accea065d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-36e6ee68-1ee0-4977-b677-8953611f6964 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:41:09 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.378s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Deleted volume successfully. Nov 03 17:41:09 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 Nov 03 17:41:09 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b3c4b697-3a28-4e56-99bb-3cf374d8913d tempest-VolumeImageDependencyTests-301932444 None] Lock "cinder-75592922-1b08-4840-8f9c-da0fad46fba5-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-quobyte-c1a2e9d7-94f2-4c50-98c2-68199cca9d19" released by "delete_volume" :: held 1.070s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Created reservations ['10ab4d5d-1008-4ae2-b525-d1679e46f7a2', '9880e06f-6d91-4191-b125-9eea656effd4', 'fbd1cac4-ab93-4188-80c4-295f92ee8a49', 'dfb094b5-f29a-42e7-a963-bbeadbc937f7'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:09 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:09 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75" returned: 0 in 0.458s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:09 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75 Nov 03 17:41:09 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 1073741824" returned: 0 in 0.549s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:09 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:09 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 Nov 03 17:41:09 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Deleted volume successfully. Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-da1ef867-31b2-41cc-8e73-484fe6b0290c tempest-CreateVolumesFromImageTest-1643034919 None] Lock "cinder-c1a2e9d7-94f2-4c50-98c2-68199cca9d19-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:09 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b68b767-45db-499d-8757-1d3bd1cb3f75" returned: 0 in 0.289s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "cinder-quobyte-9b68b767-45db-499d-8757-1d3bd1cb3f75" released by "delete_volume" :: held 0.816s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Created reservations ['5f2ebfab-083d-4e6c-9338-ba55b83f095b', 'a4b3b2a2-a8c7-4873-a4e0-d846bb457a05', '426212e3-f3bd-468e-b7fb-6673dd4bb9d8', '6202a350-95b0-4c9c-9231-d875ef454d4a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:10 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c08084-cae2-431b-b2c4-11f7c45caecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fb978e-450f-452b-b21b-b9b4be449bb5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a6e386-f074-476e-9e57-1cdfeac960d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:10 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Volume volume-35fb978e-450f-452b-b21b-b9b4be449bb5 (35fb978e-450f-452b-b21b-b9b4be449bb5): created successfully Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a6e386-f074-476e-9e57-1cdfeac960d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Flow 'volume_create_manager' (a38e0a6f-e03f-44c5-bbba-1c79abc5d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7872b244-829d-4528-9b1f-12a60f4d0d9f tempest-CreateVolumesFromSnapshotTest-612416928 None] Created volume successfully. Nov 03 17:41:10 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:10 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:10 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.297s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Deleted volume successfully. Nov 03 17:41:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c2a02792-872d-4200-aabc-bafc8e90d030 tempest-VolumeAndVolumeTypeFromImageTest-1931071799 None] Lock "cinder-9b68b767-45db-499d-8757-1d3bd1cb3f75-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-35fb978e-450f-452b-b21b-b9b4be449bb5-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-35fb978e-450f-452b-b21b-b9b4be449bb5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-35fb978e-450f-452b-b21b-b9b4be449bb5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-35fb978e-450f-452b-b21b-b9b4be449bb5" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[78431002-b993-444e-a493-887e49f8b1ad]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:11 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 Nov 03 17:41:11 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:11 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5" returned: 0 in 0.503s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:11 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5 Nov 03 17:41:11 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:12 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-35fb978e-450f-452b-b21b-b9b4be449bb5" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-35fb978e-450f-452b-b21b-b9b4be449bb5" released by "delete_volume" :: held 0.911s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['abb5cc1c-d002-4588-b72f-27d000b3c061', 'f5117c91-b796-4253-80a0-cdb745e0187b', '11f54b39-6c45-4456-ad2e-f5746a4617af', '717e6a34-dd68-4742-a338-13bd423d097e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:12 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:12 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-71531ff5-caaa-4414-bada-59f04c1718d1-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-71531ff5-caaa-4414-bada-59f04c1718d1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-71531ff5-caaa-4414-bada-59f04c1718d1" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-71531ff5-caaa-4414-bada-59f04c1718d1" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf428ea-7b35-4d7f-bb5d-63bf3662d9ce]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:12 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.448s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-35a1f4ed-fbbf-4581-953c-cc0ca916f963 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-35fb978e-450f-452b-b21b-b9b4be449bb5-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:12 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 Nov 03 17:41:12 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:13 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1" returned: 0 in 0.532s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:13 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1 Nov 03 17:41:13 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:13 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-71531ff5-caaa-4414-bada-59f04c1718d1" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-71531ff5-caaa-4414-bada-59f04c1718d1" released by "delete_volume" :: held 0.938s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['27d33f02-1041-40ed-8c74-66b408454c38', 'b419d88e-d8a6-4daa-949e-eb8717ea0b28', 'e2d751b1-d5c4-4332-9752-12a85428d913', 'f75747c2-465c-4322-ab3a-ac4cdc73edcc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:13 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:13 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:14 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:14 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1f2fa7b-8945-43dd-a2dc-1d7b328d616f tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-71531ff5-caaa-4414-bada-59f04c1718d1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-77517e60-af01-4f79-803a-81c6df7a155e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-77517e60-af01-4f79-803a-81c6df7a155e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-77517e60-af01-4f79-803a-81c6df7a155e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-77517e60-af01-4f79-803a-81c6df7a155e" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc2de3-47d5-4679-a8b3-d84165d0828d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:15 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e Nov 03 17:41:15 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:15 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e" returned: 0 in 0.442s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:15 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e Nov 03 17:41:15 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Flow 'volume_create_manager' (e55c86ce-b59c-42e9-80a9-00b0950de27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e960994-c24b-45da-b1c5-e23bd178359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e960994-c24b-45da-b1c5-e23bd178359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff019aa5-cdaf-49b1-8608-0920929db6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf64db766684a679a6bd2592769a664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:16Z,use_quota=True,user_id='e93c068598074f80b522ac308cb98ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb42a7-e8dd-47a2-b650-9b417c2c7b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb42a7-e8dd-47a2-b650-9b417c2c7b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c389f00-6275-417a-8dd3-33b5a75efb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c389f00-6275-417a-8dd3-33b5a75efb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff019aa5-cdaf-49b1-8608-0920929db6b0', 'volume_name': 'volume-ff019aa5-cdaf-49b1-8608-0920929db6b0', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6088e089-4c75-45d3-9a2e-72d8e79443a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6088e089-4c75-45d3-9a2e-72d8e79443a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecd4936-ceed-41d0-9bff-e14cebab31c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:15 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Volume ff019aa5-cdaf-49b1-8608-0920929db6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff019aa5-cdaf-49b1-8608-0920929db6b0', 'volume_size': 1} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff019aa5-cdaf-49b1-8608-0920929db6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf64db766684a679a6bd2592769a664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:16Z,use_quota=True,user_id='e93c068598074f80b522ac308cb98ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Creating volume ff019aa5-cdaf-49b1-8608-0920929db6b0 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:15 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:15 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 1073741824 Nov 03 17:41:15 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:15 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-77517e60-af01-4f79-803a-81c6df7a155e" returned: 0 in 0.381s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-77517e60-af01-4f79-803a-81c6df7a155e" released by "delete_volume" :: held 0.898s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['9baf34d6-92c6-4f92-9ea4-dfebc5beb618', '298114b5-04bc-4fb8-9209-57a910d8188d', 'd7c05191-2c85-4edd-9381-11d35148e244', '95dce390-f1bc-40e0-b489-2196bde14c55'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:16 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:16 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24306d-51ee-4098-ab00-7bc23b48234d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:16 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 1073741824" returned: 0 in 0.757s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:16 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:16 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 Nov 03 17:41:16 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-acaad61e-ede7-42ae-a2ed-d6225094d80b tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-77517e60-af01-4f79-803a-81c6df7a155e-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:16 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 Nov 03 17:41:16 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:16 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:16 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" returned: 0 in 0.522s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0" returned: 0 in 0.356s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:16 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02 Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecd4936-ceed-41d0-9bff-e14cebab31c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff019aa5-cdaf-49b1-8608-0920929db6b0', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:16 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:16 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889691c8-6df8-4c12-b65e-f404b2247482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:16 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Volume volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 (ff019aa5-cdaf-49b1-8608-0920929db6b0): created successfully Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889691c8-6df8-4c12-b65e-f404b2247482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Flow 'volume_create_manager' (e55c86ce-b59c-42e9-80a9-00b0950de27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-89a1d555-a1f3-4262-bd2b-bda890530444 tempest-CinderUnicodeTest-316180627 None] Created volume successfully. Nov 03 17:41:17 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" returned: 0 in 0.323s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02" released by "delete_volume" :: held 0.935s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['287037f4-d091-46ff-98ad-5c8055a4725a', '817baef9-f448-4210-9009-5740159d1ec0', '01d3c9e6-d887-45f8-9eac-a71b6675a8e5', '41fb1b8b-c6bf-40b1-83ee-2fa75160e891'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:17 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:17 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Flow 'volume_create_manager' (2a5fb7e1-1aa1-4503-9350-a63725601670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fa55bc-60b4-46d7-b369-88da8fe29451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fa55bc-60b4-46d7-b369-88da8fe29451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1263968027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eeac3b6-08ec-4a30-9d96-44076f7e1f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0207e363d88a4623b40ca7fb38280827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='9f959b95ef2946bcbe49299ba0938094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e5396-0375-4ea1-bb1e-c0af8c366386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e5396-0375-4ea1-bb1e-c0af8c366386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd4216b-9b34-4906-b3b3-f63c7b77f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd4216b-9b34-4906-b3b3-f63c7b77f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eeac3b6-08ec-4a30-9d96-44076f7e1f03', 'volume_name': 'volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d002ec92-adb1-4847-bc69-c0cc3300a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d002ec92-adb1-4847-bc69-c0cc3300a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684ed7d5-e20d-43ec-8add-9f9bb69fec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Volume 3eeac3b6-08ec-4a30-9d96-44076f7e1f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03', 'volume_size': 1} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1263968027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eeac3b6-08ec-4a30-9d96-44076f7e1f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0207e363d88a4623b40ca7fb38280827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='9f959b95ef2946bcbe49299ba0938094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Creating volume 3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.339s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:17 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 1073741824 Nov 03 17:41:17 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (bfa76104-75e2-4b36-b533-e4ec61ac5e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700c4641-6b8d-4bf3-a143-54abbc63bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700c4641-6b8d-4bf3-a143-54abbc63bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181671853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da252849-0b12-443a-b699-27fbbe4f8289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093a9cb6-0254-46ac-95fa-0825223f17af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093a9cb6-0254-46ac-95fa-0825223f17af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f9df31-38ec-430c-8d8d-b8b0c153dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f9df31-38ec-430c-8d8d-b8b0c153dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da252849-0b12-443a-b699-27fbbe4f8289', 'volume_name': 'volume-da252849-0b12-443a-b699-27fbbe4f8289', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a831ca-33e9-4662-9958-6bb2f8e5e15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a831ca-33e9-4662-9958-6bb2f8e5e15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da426ca6-c587-4a73-88a3-8c351805f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Volume da252849-0b12-443a-b699-27fbbe4f8289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da252849-0b12-443a-b699-27fbbe4f8289', 'volume_size': 1} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8bf681e5-64a0-43ad-a627-417461cb05a9 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-8f6e48f6-4d07-4f55-bbf3-bb3f53319e02-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Flow 'volume_create_manager' (1565cc50-bc61-4143-b7e5-aa49aa752f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff343bbc-e26d-4473-96ad-b7326b5fc3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff343bbc-e26d-4473-96ad-b7326b5fc3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631174036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b11d9e-c190-48a3-b1ad-b8924fdeb001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf64db766684a679a6bd2592769a664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='e93c068598074f80b522ac308cb98ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4327dabe-7ec1-4be8-92dd-a57b18c3f09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4327dabe-7ec1-4be8-92dd-a57b18c3f09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30867aef-919d-4334-8378-a0653ab088c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30867aef-919d-4334-8378-a0653ab088c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b11d9e-c190-48a3-b1ad-b8924fdeb001', 'volume_name': 'volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90541a0e-91cd-418e-a834-0a33700b1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90541a0e-91cd-418e-a834-0a33700b1abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d248920-e988-4123-9b91-6c1bcaf1ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Volume 27b11d9e-c190-48a3-b1ad-b8924fdeb001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001', 'volume_size': 1} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 1073741824" returned: 0 in 0.502s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:18 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:18 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:18 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181671853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da252849-0b12-443a-b699-27fbbe4f8289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Creating volume da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:18 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" acquired by "delete_volume" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:18 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 1073741824 Nov 03 17:41:18 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684ed7d5-e20d-43ec-8add-9f9bb69fec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1fefce-8f73-4d3d-8f81-495253717c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaef1a2-1e4f-4381-ad0f-9e986f4e6c53]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Volume volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 (3eeac3b6-08ec-4a30-9d96-44076f7e1f03): created successfully Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1fefce-8f73-4d3d-8f81-495253717c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Flow 'volume_create_manager' (2a5fb7e1-1aa1-4503-9350-a63725601670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cbafceaa-05f1-4603-b592-f92ba74a2b5d tempest-VolumeDependencyTests-615413450 None] Created volume successfully. Nov 03 17:41:18 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 Nov 03 17:41:18 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:18 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 1073741824" returned: 0 in 0.453s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" returned: 0 in 0.433s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 Nov 03 17:41:19 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:19 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1 Nov 03 17:41:19 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:19 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631174036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b11d9e-c190-48a3-b1ad-b8924fdeb001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf64db766684a679a6bd2592769a664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:18Z,use_quota=True,user_id='e93c068598074f80b522ac308cb98ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Creating volume 27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:19 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" returned: 0 in 0.292s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 1073741824 Nov 03 17:41:19 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da426ca6-c587-4a73-88a3-8c351805f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da252849-0b12-443a-b699-27fbbe4f8289', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee99fac-c8a9-441b-9b24-cc69728a8352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1" released by "delete_volume" :: held 0.813s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Volume volume-da252849-0b12-443a-b699-27fbbe4f8289 (da252849-0b12-443a-b699-27fbbe4f8289): created successfully Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee99fac-c8a9-441b-9b24-cc69728a8352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (bfa76104-75e2-4b36-b533-e4ec61ac5e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-30c8c902-60ec-4cd2-ad0f-838f662e9264 tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['7ae98cde-4af1-4cad-8c16-c5d874ebeaaa', '740ad889-9001-47f6-80f1-6fe5beaf6ea7', '685e1c4e-244b-43a2-a6af-247a8049716d', '4d52a209-47a2-4911-9519-80a2f00b0442'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-24dd7aa7-b325-4beb-8584-babaf074a996-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-24dd7aa7-b325-4beb-8584-babaf074a996-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-24dd7aa7-b325-4beb-8584-babaf074a996" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-24dd7aa7-b325-4beb-8584-babaf074a996" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleting offline snapshot 24dd7aa7-b325-4beb-8584-babaf074a996 of volume bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] snapshot_file for this snap is: volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad44eed-2ea1-4ead-9fb0-4d912dc5b1f2]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.329s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:19 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:19 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 1073741824" returned: 0 in 0.568s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:19 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5abd4565-2ed1-4db7-a731-48d2f9253638 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-4ca70c65-4769-48ad-8b0a-a83bc9e47bb1-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:19 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 Nov 03 17:41:19 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:20 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996" returned: 0 in 0.394s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ee997-211c-4f5b-9e66-3fab411be180]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:20 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d248920-e988-4123-9b91-6c1bcaf1ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42695f5-2bf6-462e-bd81-fcfe5309475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Creating offline snapshot 591d7435-549f-4e2a-b723-097651b1289d of volume 3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c40ba4-5975-42a3-84c0-4b253c8d6447]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Volume volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 (27b11d9e-c190-48a3-b1ad-b8924fdeb001): created successfully Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42695f5-2bf6-462e-bd81-fcfe5309475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Flow 'volume_create_manager' (1565cc50-bc61-4143-b7e5-aa49aa752f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5011e0e8-8a10-4c35-b54a-c3bbe13b9582 tempest-CinderUnicodeTest-316180627 None] Created volume successfully. Nov 03 17:41:20 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 Nov 03 17:41:20 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:20 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:20 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:20 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:20 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 Nov 03 17:41:20 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:20 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.483s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:20 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d 1G Nov 03 17:41:20 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:21 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996" returned: 0 in 0.449s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:21 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996 Nov 03 17:41:21 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:21 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d 1G" returned: 0 in 0.477s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:21 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:21 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:21 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9.24dd7aa7-b325-4beb-8584-babaf074a996" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-24dd7aa7-b325-4beb-8584-babaf074a996" released by "_delete_snapshot" :: held 1.721s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" released by "delete_snapshot" :: held 1.752s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['48a7b2b4-d141-4112-b5fc-a1f672d0da60', '23ca5e6b-b7ef-4d31-968b-8bbccff33b2a', 'f3342d5f-a7e1-437e-b693-f40cf6a9694b', '9018ac27-444e-4259-b8f9-8b6b91b84b8f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:21 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.390s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:21 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d is being set with open permissions: ugo+rw Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:21 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Delete snapshot completed successfully. Nov 03 17:41:21 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:21 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8aedab03-73bc-48a6-a0ed-831989d6a596 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-24dd7aa7-b325-4beb-8584-babaf074a996-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-bd29f96b-a490-4c50-a76e-a1c27c540cf9-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-bd29f96b-a490-4c50-a76e-a1c27c540cf9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:21 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.301s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f404b0f7-0d99-45a4-b9b0-2cfe11b49d4e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info Nov 03 17:41:22 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:22 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 Nov 03 17:41:22 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:22 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info" returned: 0 in 0.247s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:22 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info is being set with open permissions: ugo+rw Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info Nov 03 17:41:22 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:22 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9" returned: 0 in 0.368s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9 Nov 03 17:41:22 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:22 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.info" returned: 0 in 0.259s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.647s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 0203737a-d918-4be8-a481-bf6e6252d632 of volume da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f0b0d6f8-8a11-47df-a8f4-c8a386005a6d tempest-VolumeDependencyTests-615413450 None] Create snapshot completed successfully Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f7c6a-cd8a-4bda-bcb9-6de4eaf9b4f7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bd29f96b-a490-4c50-a76e-a1c27c540cf9" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-quobyte-bd29f96b-a490-4c50-a76e-a1c27c540cf9" released by "delete_volume" :: held 0.697s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Created reservations ['9df0e75b-8c86-4f1f-b09f-027c157b1a77', 'a8eb3aa3-007a-4409-971c-f0d016e16559', 'cfa5c857-1574-4cfc-be3e-596b71d3fa0d', 'de485a79-496b-4f58-9bf6-22b26f131427'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:22 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 Nov 03 17:41:22 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:22 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:22 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:23 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:23 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 1G Nov 03 17:41:23 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:23 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:23 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Deleted volume successfully. Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4923fb01-2760-435c-b6a0-f7846b166d47 tempest-CreateVolumesFromSnapshotTest-612416928 None] Lock "cinder-bd29f96b-a490-4c50-a76e-a1c27c540cf9-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Flow 'volume_create_manager' (fa594142-b65c-47ce-b186-4dddd0f48871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bf84d-c170-4f46-b464-077b020fef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bf84d-c170-4f46-b464-077b020fef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1962182026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153e750b-6d74-4dc0-be99-28bdf73190dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0207e363d88a4623b40ca7fb38280827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=591d7435-549f-4e2a-b723-097651b1289d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:23Z,use_quota=True,user_id='9f959b95ef2946bcbe49299ba0938094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed53efc2-ccd9-42c2-95d1-4cd6920c0c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed53efc2-ccd9-42c2-95d1-4cd6920c0c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26436c40-443a-46c9-8036-9a5830172576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26436c40-443a-46c9-8036-9a5830172576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '153e750b-6d74-4dc0-be99-28bdf73190dd', 'volume_name': 'volume-153e750b-6d74-4dc0-be99-28bdf73190dd', 'volume_size': 1, 'snapshot_id': '591d7435-549f-4e2a-b723-097651b1289d'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd073b45-612c-4b08-ac1b-5617f2c69c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd073b45-612c-4b08-ac1b-5617f2c69c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c02bc-157f-475f-8d49-7483e760ed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:23 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Volume 153e750b-6d74-4dc0-be99-28bdf73190dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-153e750b-6d74-4dc0-be99-28bdf73190dd', 'volume_size': 1, 'snapshot_id': '591d7435-549f-4e2a-b723-097651b1289d'} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:23 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 1G" returned: 0 in 0.563s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da252849-0b12-443a-b699-27fbbe4f8289 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:23 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da252849-0b12-443a-b699-27fbbe4f8289 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 Nov 03 17:41:23 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:23 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da252849-0b12-443a-b699-27fbbe4f8289 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632" returned: 0 in 0.327s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:23 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 is being set with open permissions: ugo+rw Nov 03 17:41:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:23 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 Nov 03 17:41:23 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:24 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:24 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info Nov 03 17:41:24 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:24 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:24 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info is being set with open permissions: ugo+rw Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:24 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info Nov 03 17:41:24 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:24 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.info" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.218s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Creating offline snapshot fd51ebd8-599a-44a7-9e29-c1ebfaa0732e of volume 27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:24 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b785695d-1c3b-4320-937b-50b03ae1b23b tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd4bde-5ca9-4f30-8296-5ef84be20b21]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:24 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 Nov 03 17:41:24 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-0203737a-d918-4be8-a481-bf6e6252d632-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-0203737a-d918-4be8-a481-bf6e6252d632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-0203737a-d918-4be8-a481-bf6e6252d632" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-0203737a-d918-4be8-a481-bf6e6252d632" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 0203737a-d918-4be8-a481-bf6e6252d632 of volume da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[39085e41-be96-4070-8857-a922d875864c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:25 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:25 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e 1G Nov 03 17:41:25 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:25 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 Nov 03 17:41:25 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:25 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632" returned: 0 in 0.463s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da252849-0b12-443a-b699-27fbbe4f8289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[15720b19-a326-4bd4-b60b-06d69b0d1de3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:25 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e 1G" returned: 0 in 0.498s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:25 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e Nov 03 17:41:25 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:25 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 Nov 03 17:41:25 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e is being set with open permissions: ugo+rw Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:26 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289" returned: 0 in 0.422s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:26 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e Nov 03 17:41:26 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 Nov 03 17:41:26 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (09ebe5c4-6ff4-4cf6-80d6-d78538f12697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2324e554-48af-4ae1-9124-188e0cca2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2324e554-48af-4ae1-9124-188e0cca2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252894501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b74fbd5-0ea2-48b2-9454-f5ad88ec7100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:26Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867c054-8e49-4898-8c7f-17568fb074b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867c054-8e49-4898-8c7f-17568fb074b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b220-474f-491d-9063-1d8c009187af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b220-474f-491d-9063-1d8c009187af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b74fbd5-0ea2-48b2-9454-f5ad88ec7100', 'volume_name': 'volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:26 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a81d95-d108-488a-b9da-4923fbb95162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a81d95-d108-488a-b9da-4923fbb95162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde9779a-cf0c-4562-a4c3-747e401a52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:26 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume 9b74fbd5-0ea2-48b2-9454-f5ad88ec7100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100', 'volume_size': 1} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:26 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632" returned: 0 in 0.391s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:26 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info Nov 03 17:41:26 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632 Nov 03 17:41:26 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info" returned: 0 in 0.272s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info is being set with open permissions: ugo+rw Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:26 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289.0203737a-d918-4be8-a481-bf6e6252d632" returned: 0 in 0.270s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:26 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info Nov 03 17:41:26 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-0203737a-d918-4be8-a481-bf6e6252d632" released by "_delete_snapshot" :: held 1.693s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" released by "delete_snapshot" :: held 1.723s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Created reservations ['882d635c-c284-477f-91a5-f60785cddc14', '2638e3c6-8341-4c80-8ccd-bb221e8bc54f', 'ff725cb7-d5a7-481d-ad7f-45f316d7b49e', 'f27deb1d-d0cf-40e8-91d1-8f9066e76216'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:41:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4424977e-6017-4a05-882c-17c46db323ba tempest-ProjectMemberTests-786257033 None] Lock "cinder-0203737a-d918-4be8-a481-bf6e6252d632-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:27 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.info" returned: 0 in 0.259s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.522s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d-153e750b-6d74-4dc0-be99-28bdf73190dd" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d-153e750b-6d74-4dc0-be99-28bdf73190dd" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Creating volume 153e750b-6d74-4dc0-be99-28bdf73190dd from snapshot 591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-08adcedd-5dfc-4114-a25b-6ad5ad071e16 tempest-CinderUnicodeTest-316180627 None] Create snapshot completed successfully Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] snapshot: 591d7435-549f-4e2a-b723-097651b1289d, volume: 153e750b-6d74-4dc0-be99-28bdf73190dd, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645614c-143d-439e-a0a3-1943fc18d7b5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-da252849-0b12-443a-b699-27fbbe4f8289-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:27 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-da252849-0b12-443a-b699-27fbbe4f8289-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1799ad02-a86a-4282-bec1-34ecb30bd06d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:27 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 Nov 03 17:41:27 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:27 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f0d015-718a-4b61-8b08-210fcd6b590d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:27 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:27 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:27 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289" returned: 0 in 0.372s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:27 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289 Nov 03 17:41:27 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-quobyte-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Deleting offline snapshot fd51ebd8-599a-44a7-9e29-c1ebfaa0732e of volume 27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:28 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] snapshot_file for this snap is: volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[26092331-74c7-4423-aeff-efe7ed181f68]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:28 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd Nov 03 17:41:28 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:28 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da252849-0b12-443a-b699-27fbbe4f8289" returned: 0 in 0.293s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da252849-0b12-443a-b699-27fbbe4f8289" released by "delete_volume" :: held 0.737s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Created reservations ['db50fd4f-fe19-4064-8659-b8980f47b449', '840428cb-1214-4aa9-a6c4-188fb22575ce', '554842a6-81d5-4aee-a1f9-eb6801ab9ba0', '500159c0-e5d5-4632-8a55-f5c408266e82'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:28 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e Nov 03 17:41:28 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:28 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:28 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:28 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:28 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" returned: 0 in 0.477s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c364f8-1939-4eb1-9ede-b0c4b9711eab]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-5eef1169-98dd-42c1-858f-b228fc459df2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-da252849-0b12-443a-b699-27fbbe4f8289-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:28 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 Nov 03 17:41:28 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (8870e64c-ae85-46b1-afed-ca5b3f556916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d107668-9881-41d7-90fc-1972159a4e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d107668-9881-41d7-90fc-1972159a4e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193455334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d989bd0-dbbf-416c-b5d8-e55a34119e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:29Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:29 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3806be85-0521-49d6-8461-3f3b4a4aa078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3806be85-0521-49d6-8461-3f3b4a4aa078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978af523-9ae6-4f78-a96c-7c273276fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978af523-9ae6-4f78-a96c-7c273276fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d989bd0-dbbf-416c-b5d8-e55a34119e99', 'volume_name': 'volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1320e1-f3b9-4ddf-b8e8-3933ae1a374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1320e1-f3b9-4ddf-b8e8-3933ae1a374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752a04fc-8a90-450e-a6f7-9084bb6c2509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:29 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Volume 6d989bd0-dbbf-416c-b5d8-e55a34119e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99', 'volume_size': 1} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001" returned: 0 in 0.938s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:29 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e Nov 03 17:41:29 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:30 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" returned: 0 in 0.647s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:30 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e Nov 03 17:41:30 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:30 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001.fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" returned: 0 in 0.378s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e" released by "_delete_snapshot" :: held 2.673s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" released by "delete_snapshot" :: held 2.702s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Created reservations ['48412255-677a-4089-87c4-64d1d28d9374', '409fe1e8-a3c6-4299-90b8-1a5336998563', '09925224-37be-4ab1-bc70-93f7cf6f5ccb', 'ba0d8510-30bc-4313-af37-c685724f9552'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Delete snapshot completed successfully. Nov 03 17:41:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-14420c4e-24bd-420c-a8c4-5328369f9b19 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-fd51ebd8-599a-44a7-9e29-c1ebfaa0732e-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-27b11d9e-c190-48a3-b1ad-b8924fdeb001-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-27b11d9e-c190-48a3-b1ad-b8924fdeb001-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" acquired by "delete_volume" :: waited 0.048s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594ed65-42d4-4b67-97b4-06b903ee7b2c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:31 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 Nov 03 17:41:31 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:32 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001" returned: 0 in 0.572s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:32 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001 Nov 03 17:41:32 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:32 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27b11d9e-c190-48a3-b1ad-b8924fdeb001" returned: 0 in 0.658s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-27b11d9e-c190-48a3-b1ad-b8924fdeb001" released by "delete_volume" :: held 1.384s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Created reservations ['0895aace-66ea-4278-93f6-b3f70295829a', '41e88000-1f6e-43a8-97b0-4a684bfd38cd', '662b5e2d-862a-481b-89cd-dc0df88008a4', '09f22e88-f9b1-4cfb-a88e-242ac430f5e4'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:33 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:33 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:33 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.412s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:33 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Deleted volume successfully. Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-4c38ef94-6081-4ee5-bc95-b2d236e597d6 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-27b11d9e-c190-48a3-b1ad-b8924fdeb001-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-ff019aa5-cdaf-49b1-8608-0920929db6b0-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-ff019aa5-cdaf-49b1-8608-0920929db6b0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:33 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "cinder-quobyte-ff019aa5-cdaf-49b1-8608-0920929db6b0" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-ff019aa5-cdaf-49b1-8608-0920929db6b0" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153caca-ce55-4655-8130-d0fa94c9d788]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:34 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 Nov 03 17:41:34 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:34 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0" returned: 0 in 0.557s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:34 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0 Nov 03 17:41:34 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:34 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ff019aa5-cdaf-49b1-8608-0920929db6b0" returned: 0 in 0.294s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-quobyte-ff019aa5-cdaf-49b1-8608-0920929db6b0" released by "delete_volume" :: held 0.955s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Created reservations ['6839fab4-0eac-4ee4-b087-6cfe953eeb58', 'aeebf6e3-707b-4758-8094-678d611c6ab1', 'eab33830-24a8-4461-80c4-b01106773f59', 'c4367239-b5aa-4fb3-b33c-275f1db9ea6e'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:35 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:35 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:35 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd" returned: 0 in 7.542s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:41:35 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Converted 1024.00 MB image at 135.71 MB/s Nov 03 17:41:35 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd is being set with open permissions: ugo+rw Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:35 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd Nov 03 17:41:35 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:35 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.464s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Deleted volume successfully. Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0eb5624b-9aa5-4e17-9680-3c63e3e3bd23 tempest-CinderUnicodeTest-316180627 None] Lock "cinder-ff019aa5-cdaf-49b1-8608-0920929db6b0-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:35 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" released by "_copy_volume_from_snapshot" :: held 8.768s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d-153e750b-6d74-4dc0-be99-28bdf73190dd" released by "_create_volume_from_snapshot" :: held 8.845s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.867s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.468s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252894501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b74fbd5-0ea2-48b2-9454-f5ad88ec7100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:26Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume 9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:35 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:35 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 1073741824 Nov 03 17:41:35 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c02bc-157f-475f-8d49-7483e760ed2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153e750b-6d74-4dc0-be99-28bdf73190dd', 'volume_size': 1, 'snapshot_id': '591d7435-549f-4e2a-b723-097651b1289d'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2af2d-0621-4f7a-95a8-8527b84ba379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:35 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Volume volume-153e750b-6d74-4dc0-be99-28bdf73190dd (153e750b-6d74-4dc0-be99-28bdf73190dd): created successfully Nov 03 17:41:35 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2af2d-0621-4f7a-95a8-8527b84ba379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Flow 'volume_create_manager' (fa594142-b65c-47ce-b186-4dddd0f48871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6bc1c509-bb0f-454d-9e6f-02b0aef0da2a tempest-VolumeDependencyTests-615413450 None] Created volume successfully. Nov 03 17:41:36 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 1073741824" returned: 0 in 0.472s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:36 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 Nov 03 17:41:36 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-591d7435-549f-4e2a-b723-097651b1289d-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-591d7435-549f-4e2a-b723-097651b1289d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Deleting offline snapshot 591d7435-549f-4e2a-b723-097651b1289d of volume 3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] snapshot_file for this snap is: volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021a4fd-a38f-405b-a60a-472b32bd88e9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:36 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" returned: 0 in 0.336s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.300s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193455334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d989bd0-dbbf-416c-b5d8-e55a34119e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:29Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Creating volume 6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:36 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:36 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:36 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde9779a-cf0c-4562-a4c3-747e401a52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:36 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 1073741824 Nov 03 17:41:36 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b775cd3-74b7-4d56-8f0f-919a3ba06b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:36 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 (9b74fbd5-0ea2-48b2-9454-f5ad88ec7100): created successfully Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b775cd3-74b7-4d56-8f0f-919a3ba06b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:36 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (09ebe5c4-6ff4-4cf6-80d6-d78538f12697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-452f6caa-5830-4f47-b9f1-bab7b1438cb8 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:37 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb155e4-2c12-4e53-9429-bd03a6f465b3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:37 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:37 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:37 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 1073741824" returned: 0 in 0.539s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:37 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 Nov 03 17:41:37 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:37 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752a04fc-8a90-450e-a6f7-9084bb6c2509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df33c51-6b11-41d9-9e2b-9036c35e024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:37 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Volume volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 (6d989bd0-dbbf-416c-b5d8-e55a34119e99): created successfully Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df33c51-6b11-41d9-9e2b-9036c35e024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (8870e64c-ae85-46b1-afed-ca5b3f556916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:37 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3d995e94-c2ab-4cf1-bc81-5344412043a6 tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:41:37 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.718s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:37 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:37 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (fb864735-06a4-427e-939f-7cae3d3fc90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c77fff-d1b9-43d3-a381-8f57c61d1be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c77fff-d1b9-43d3-a381-8f57c61d1be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136046107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9744918-bc9c-4f38-9054-33d8043b8727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:38Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343ddb56-c533-4670-9cb2-a1444b598ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343ddb56-c533-4670-9cb2-a1444b598ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643194ce-0cdf-4a52-8224-ed3cadcc260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643194ce-0cdf-4a52-8224-ed3cadcc260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9744918-bc9c-4f38-9054-33d8043b8727', 'volume_name': 'volume-e9744918-bc9c-4f38-9054-33d8043b8727', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e571ac9d-ab7d-4bfd-bb08-63983087c1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e571ac9d-ab7d-4bfd-bb08-63983087c1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec6c50-4e59-49f1-98f4-bc62406d085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume e9744918-bc9c-4f38-9054-33d8043b8727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9744918-bc9c-4f38-9054-33d8043b8727', 'volume_size': 1} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136046107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9744918-bc9c-4f38-9054-33d8043b8727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:38Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume e9744918-bc9c-4f38-9054-33d8043b8727 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:38 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:38 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 1073741824 Nov 03 17:41:38 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:38 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.638s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:38 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d Nov 03 17:41:38 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (4a6dfed1-5df1-4fff-8fb3-fec2762280b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6752eee8-f431-4803-9358-66124e0a8172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6752eee8-f431-4803-9358-66124e0a8172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9394173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1277a36c-32c4-42d0-a4fc-8d79428b96c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587ce4c1-d0f7-4026-841c-a98cb4e7fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587ce4c1-d0f7-4026-841c-a98cb4e7fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84673fa-74f9-48c3-a010-a9157d54ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84673fa-74f9-48c3-a010-a9157d54ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1277a36c-32c4-42d0-a4fc-8d79428b96c7', 'volume_name': 'volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c1cea9-7a6a-49bb-b454-76a504619aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c1cea9-7a6a-49bb-b454-76a504619aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c35dc1-4dc0-410b-8ee0-c12a8f9c5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:38 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume 1277a36c-32c4-42d0-a4fc-8d79428b96c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7', 'volume_size': 1} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:38 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 1073741824" returned: 0 in 0.747s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:38 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:38 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:39 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 Nov 03 17:41:39 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:39 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03.591d7435-549f-4e2a-b723-097651b1289d" returned: 0 in 0.547s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-591d7435-549f-4e2a-b723-097651b1289d" released by "_delete_snapshot" :: held 2.505s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" released by "delete_snapshot" :: held 2.546s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Created reservations ['be896cde-c784-421e-aaa5-b068227bc636', '8556cef4-ff42-4eba-82bc-2464b30bcd5d', 'e006c550-ac46-4550-ae8a-1586a991cd81', '9f8d6858-bcd5-4ee7-a800-b21258c1278c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:39 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.421s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (b0f754e7-d25e-42a0-9290-f43b434bdadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:39 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56174b1b-e013-48f0-8b1e-6f20151ce989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727" returned: 0 in 0.427s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.728s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec6c50-4e59-49f1-98f4-bc62406d085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9744918-bc9c-4f38-9054-33d8043b8727', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155217a4-4e99-4a03-96fe-bba72eb610cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56174b1b-e013-48f0-8b1e-6f20151ce989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817293042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5a3651-ca66-4bed-bd92-6ce69a431b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5a3651-ca66-4bed-bd92-6ce69a431b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba86076-285f-4b8f-931e-1504bbd7cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba86076-285f-4b8f-931e-1504bbd7cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f', 'volume_name': 'volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7cfc62-1186-4893-886e-dd3ab81cb1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7cfc62-1186-4893-886e-dd3ab81cb1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9ee5fd-a8a5-45d0-81a8-55a4bf905385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume 6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f', 'volume_size': 1} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:39 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-e9744918-bc9c-4f38-9054-33d8043b8727 (e9744918-bc9c-4f38-9054-33d8043b8727): created successfully Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155217a4-4e99-4a03-96fe-bba72eb610cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (fb864735-06a4-427e-939f-7cae3d3fc90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 1032e1b7-5647-4dd9-968f-3c815cddca0b of volume 6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9ca65ff9-ddcd-405c-9bcb-bb402accae5f tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (0dd92d36-949a-4d92-8ab2-df60c6536914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe30406-b332-4107-8096-700bdc69d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c987d639-b51b-47c2-a426-560ae5179563]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe30406-b332-4107-8096-700bdc69d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590997846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6388b1a0-a9b0-4a15-87c5-826ba72bc85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4325c534-e782-46ee-81a0-2312b1d25f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4325c534-e782-46ee-81a0-2312b1d25f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de2965b-f2c3-4e0f-9cb8-bda3abeac24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de2965b-f2c3-4e0f-9cb8-bda3abeac24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6388b1a0-a9b0-4a15-87c5-826ba72bc85c', 'volume_name': 'volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fff372-e815-4804-9c1a-cad3f438ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fff372-e815-4804-9c1a-cad3f438ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf6e0c6-db38-44f1-9c5c-3cd2220574c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:39 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume 6388b1a0-a9b0-4a15-87c5-826ba72bc85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c', 'volume_size': 1} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:39 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Delete snapshot completed successfully. Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-3eeac3b6-08ec-4a30-9d96-44076f7e1f03-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-bc89b0b6-cc1c-4f45-9303-af9ad420a789 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-591d7435-549f-4e2a-b723-097651b1289d-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-3eeac3b6-08ec-4a30-9d96-44076f7e1f03-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:39 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 Nov 03 17:41:39 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89bc2ed-b894-463f-a1c6-3e02da3189e9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (1d8a3a6c-c9de-4bd0-91ac-2c33c9006abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a58fc8-4f67-4863-8395-2913153bcd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a58fc8-4f67-4863-8395-2913153bcd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1495909188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:40Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89f710-ba40-46a7-a3c9-53d4b589bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89f710-ba40-46a7-a3c9-53d4b589bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2badb5eb-d3f4-44db-932a-acc8ce05362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2badb5eb-d3f4-44db-932a-acc8ce05362b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314', 'volume_name': 'volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263c576-f95c-4393-8ae2-5ece05a8d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263c576-f95c-4393-8ae2-5ece05a8d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf2ead4-4c60-4c98-8747-1c47714a141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:40 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314', 'volume_size': 1} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:40 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:40 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:40 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99" returned: 0 in 0.479s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:40 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b 1G Nov 03 17:41:40 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:40 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.397s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:40 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03 Nov 03 17:41:40 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:40 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b 1G" returned: 0 in 0.485s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:40 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b Nov 03 17:41:40 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:40 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-3eeac3b6-08ec-4a30-9d96-44076f7e1f03" released by "delete_volume" :: held 0.759s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Created reservations ['82f7df46-c8fd-4755-bff8-96535c55b649', '70331bb9-90c8-460c-ab35-59dacd981a7c', 'bba87d3f-d8e9-4963-9e72-7fe721a170d3', '7a28adc9-4787-4e32-a96e-d50292680680'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:40 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:40 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b" returned: 0 in 0.393s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:41 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b is being set with open permissions: ugo+rw Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:41 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b Nov 03 17:41:41 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-153e750b-6d74-4dc0-be99-28bdf73190dd-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-153e750b-6d74-4dc0-be99-28bdf73190dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:41 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.309s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Deleted volume successfully. Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2c728e76-c6d0-433c-ba3e-b3d86cc2ae14 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-3eeac3b6-08ec-4a30-9d96-44076f7e1f03-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f0f92a-2b6b-4af3-8201-7efb52c7c892]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:41 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b" returned: 0 in 0.294s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:41 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd Nov 03 17:41:41 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:41 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info Nov 03 17:41:41 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:41 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd Nov 03 17:41:41 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:41 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info is being set with open permissions: ugo+rw Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:41 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info Nov 03 17:41:41 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:41 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-153e750b-6d74-4dc0-be99-28bdf73190dd" returned: 0 in 0.266s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-quobyte-153e750b-6d74-4dc0-be99-28bdf73190dd" released by "delete_volume" :: held 0.694s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:42 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.info" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.182s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9394173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1277a36c-32c4-42d0-a4fc-8d79428b96c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume 1277a36c-32c4-42d0-a4fc-8d79428b96c7 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:42 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:42 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 1073741824 Nov 03 17:41:42 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-47789c8a-8f71-46bc-9c48-37e06045b213 tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Created reservations ['311c7299-51ca-4e71-8c9e-18671d8ca837', '72be48ce-b5f4-46ef-9754-fec965e012cc', 'e4f7c0de-8fff-4f33-a70c-ba5a4b677523', 'c023d0fb-e009-430a-9db7-5322d9d25610'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:42 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:42 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:42 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Deleted volume successfully. Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ad81f1c0-d53f-40cd-8430-dfe6f74e3559 tempest-VolumeDependencyTests-615413450 None] Lock "cinder-153e750b-6d74-4dc0-be99-28bdf73190dd-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:42 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 1073741824" returned: 0 in 0.543s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:42 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 Nov 03 17:41:42 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-1032e1b7-5647-4dd9-968f-3c815cddca0b-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-1032e1b7-5647-4dd9-968f-3c815cddca0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-1032e1b7-5647-4dd9-968f-3c815cddca0b" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-1032e1b7-5647-4dd9-968f-3c815cddca0b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 1032e1b7-5647-4dd9-968f-3c815cddca0b of volume 6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00901d0-72ed-4050-9b81-1a72947299e1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:42 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.338s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817293042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume 6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:43 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c35dc1-4dc0-410b-8ee0-c12a8f9c5e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d80aaeb-e7ba-4fd4-85e5-2e598d0a0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:43 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b Nov 03 17:41:43 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:43 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f 1073741824 Nov 03 17:41:43 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:43 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 (1277a36c-32c4-42d0-a4fc-8d79428b96c7): created successfully Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d80aaeb-e7ba-4fd4-85e5-2e598d0a0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (4a6dfed1-5df1-4fff-8fb3-fec2762280b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8b8f8a1e-7571-4d94-8028-20dc6a534e67 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:43 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b" returned: 0 in 0.574s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfc6ca-8336-4d7a-8979-e31b6d4bbc5d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:43 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f 1073741824" returned: 0 in 0.583s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:43 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 Nov 03 17:41:43 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:43 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f Nov 03 17:41:43 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:43 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:43 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99" returned: 0 in 0.487s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" returned: 0 in 0.373s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:44 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.151s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:44 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590997846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6388b1a0-a9b0-4a15-87c5-826ba72bc85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:39Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume 6388b1a0-a9b0-4a15-87c5-826ba72bc85c {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:44 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9ee5fd-a8a5-45d0-81a8-55a4bf905385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea915590-e467-4590-bf15-a3cb59120f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:44 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c 1073741824 Nov 03 17:41:44 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:44 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f (6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f): created successfully Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea915590-e467-4590-bf15-a3cb59120f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (b0f754e7-d25e-42a0-9290-f43b434bdadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-09d533db-ba60-4fd4-bc03-1712c84b91a0 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:44 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b" returned: 0 in 0.455s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:44 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b Nov 03 17:41:44 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:44 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c 1073741824" returned: 0 in 0.655s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:44 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c Nov 03 17:41:44 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:44 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99.1032e1b7-5647-4dd9-968f-3c815cddca0b" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-1032e1b7-5647-4dd9-968f-3c815cddca0b" released by "_delete_snapshot" :: held 2.039s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" released by "delete_snapshot" :: held 2.073s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:44 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Created reservations ['e0992840-e112-4854-b922-043da5b770be', '410e02ed-f8eb-462e-af97-4e7f365c973b', '8b84436f-37a1-4aee-bac6-d7156c9d7049', 'fc17330b-25f7-41cb-b600-95d5ed93d08b'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:45 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" returned: 0 in 0.304s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.809s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1495909188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335580f54f734b95b391f27b06c95e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:40Z,use_quota=True,user_id='6f00e414cd6f450ba0823690ccb06681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Creating volume ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf6e0c6-db38-44f1-9c5c-3cd2220574c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:45 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 1073741824 Nov 03 17:41:45 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1595b91e-6a55-4617-9d9e-5e4c64f380c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c (6388b1a0-a9b0-4a15-87c5-826ba72bc85c): created successfully Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1595b91e-6a55-4617-9d9e-5e4c64f380c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (0dd92d36-949a-4d92-8ab2-df60c6536914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3fec1de4-fa43-4b6a-b4ee-00120a3d395e tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-aeccb78f-dfea-4405-b114-ebd700b68db8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-1032e1b7-5647-4dd9-968f-3c815cddca0b-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:45 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 1073741824" returned: 0 in 0.488s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:45 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 Nov 03 17:41:45 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:45 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf2ead4-4c60-4c98-8747-1c47714a141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8eeae91-7074-4da1-9dec-82b74299fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Volume volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 (ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314): created successfully Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8eeae91-7074-4da1-9dec-82b74299fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Flow 'volume_create_manager' (1d8a3a6c-c9de-4bd0-91ac-2c33c9006abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:45 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e8cc9e06-e1ba-412a-a693-5e105f1c6e85 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created volume successfully. Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-6d989bd0-dbbf-416c-b5d8-e55a34119e99-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "cinder-6d989bd0-dbbf-416c-b5d8-e55a34119e99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db628a-2e29-46bc-bc99-1df967e3ebef]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (f91597c9-cc6e-4e8d-9a47-2de60d270f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0edd0f9-e31e-42f7-a914-fa798ec272fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0edd0f9-e31e-42f7-a914-fa798ec272fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020974741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:46Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779fac06-5a32-46ad-8818-322d958b04aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779fac06-5a32-46ad-8818-322d958b04aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625e691b-5adc-4dd9-b23d-a36d1eb4a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:46 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 Nov 03 17:41:46 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625e691b-5adc-4dd9-b23d-a36d1eb4a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f', 'volume_name': 'volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cd8fd8-b850-4fc0-8839-a7a0756cc34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cd8fd8-b850-4fc0-8839-a7a0756cc34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3970afc-a80b-4086-8108-985cddd0e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:46 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Volume 0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f', 'volume_size': 1} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020974741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:46Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Creating volume 0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:46 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:46 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f 1073741824 Nov 03 17:41:46 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:46 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99" returned: 0 in 0.409s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:46 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99 Nov 03 17:41:46 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:46 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f 1073741824" returned: 0 in 0.533s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6d989bd0-dbbf-416c-b5d8-e55a34119e99" returned: 0 in 0.363s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f Nov 03 17:41:47 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-6d989bd0-dbbf-416c-b5d8-e55a34119e99" released by "delete_volume" :: held 0.859s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" acquired by "delete_volume" :: waited 0.034s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[406941e4-9059-48ce-a9b1-b3b24ccffeb7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Flow 'volume_create_manager' (982cc0f7-b8a1-49e2-b274-a626a23b7a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f422a2-5118-4204-a624-317a4af47fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f422a2-5118-4204-a624-317a4af47fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428418716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d5d0f018524bf384d995dee0efa298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:47Z,use_quota=True,user_id='c03d35a595db4b24b88ef36bb7f02b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf27006-24db-4e26-a597-bfd4fbfe108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf27006-24db-4e26-a597-bfd4fbfe108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62547772-45a1-441d-a544-f6b809046679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62547772-45a1-441d-a544-f6b809046679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00', 'volume_name': 'volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61816514-172e-4974-a1f7-606b14830955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61816514-172e-4974-a1f7-606b14830955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07937c71-3579-4009-b3de-b3eaea163a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Volume f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00', 'volume_size': 1} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Created reservations ['9f1c7acc-ad15-4816-8ab5-f7bbaf8922b9', 'c5aa2896-488f-4a6d-99e4-a511d472b2a0', 'f0dd4bd2-21e2-4db6-a072-bdc585aedf13', '8c5c4763-e04e-4fb0-a35c-dfa361f3c3f8'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:47 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" returned: 0 in 0.279s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428418716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d5d0f018524bf384d995dee0efa298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:47Z,use_quota=True,user_id='c03d35a595db4b24b88ef36bb7f02b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Creating volume f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:47 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3970afc-a80b-4086-8108-985cddd0e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86938366-96f0-4575-80f6-94c78d0bafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:47 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 1073741824 Nov 03 17:41:47 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Volume volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f (0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f): created successfully Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86938366-96f0-4575-80f6-94c78d0bafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (f91597c9-cc6e-4e8d-9a47-2de60d270f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9ce0c2f5-c855-422a-8bf8-eaaf27b48c11 tempest-ProjectReaderTests-562863205 None] Created volume successfully. Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:47 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314 Nov 03 17:41:47 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0669b316-1131-4b7e-bfe5-aeff51c5ff52 tempest-ProjectMemberTests-786257033 None] Lock "cinder-6d989bd0-dbbf-416c-b5d8-e55a34119e99-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:47 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 1073741824" returned: 0 in 0.436s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" returned: 0 in 0.246s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314" released by "delete_volume" :: held 0.708s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 Nov 03 17:41:47 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['d6a20621-43c9-49dc-a8d3-9faa0727af84', '20dafcc3-b096-440f-88e5-7bf6e62a551e', 'aa9924fc-3c5f-4200-abc3-e66cd3bbc0e6', '8c8dfc83-7828-40c6-8f2c-f41685f302dc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:47 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:47 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:48 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" returned: 0 in 0.257s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07937c71-3579-4009-b3de-b3eaea163a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcf755a-51dc-4f97-b2fd-b066ba1a624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Volume volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 (f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00): created successfully Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcf755a-51dc-4f97-b2fd-b066ba1a624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Flow 'volume_create_manager' (982cc0f7-b8a1-49e2-b274-a626a23b7a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3d6b30f3-4992-41f9-aab0-a8aa72eb9261 tempest-ProjectReaderTests-1635003593 None] Created volume successfully. Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-6388b1a0-a9b0-4a15-87c5-826ba72bc85c-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-6388b1a0-a9b0-4a15-87c5-826ba72bc85c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:48 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.271s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:48 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7f94819b-05db-4f83-953f-202145e9c88c tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-ae7bb2d6-bb5f-4b79-af2d-1b42eeb98314-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ddda3b-5298-45e2-a002-98221349e6c8]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:48 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c Nov 03 17:41:48 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:48 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" returned: 0 in 0.396s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:48 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c Nov 03 17:41:48 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Creating offline snapshot fbdeda58-39d3-4f95-9c41-015c623e3d1a of volume 0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02c87f5-0d1e-494f-bc3e-aba5da579666]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:48 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f Nov 03 17:41:48 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (ae09a12a-a66e-4208-af49-cc8ea414cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075a7631-5524-4a64-8ed0-964a54e116be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075a7631-5524-4a64-8ed0-964a54e116be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051149209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0a7033-05a5-47a8-a2c0-e9b8047fe5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:49Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f010697-c1d2-4ab7-9917-57bc422ed986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f010697-c1d2-4ab7-9917-57bc422ed986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82340a1-de4f-4bb7-960d-d822631008c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82340a1-de4f-4bb7-960d-d822631008c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0a7033-05a5-47a8-a2c0-e9b8047fe5db', 'volume_name': 'volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f5149b-e279-499b-8a1c-0eaee6c21e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f5149b-e279-499b-8a1c-0eaee6c21e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa97803-162e-440c-ab33-11c831c7010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Volume bb0a7033-05a5-47a8-a2c0-e9b8047fe5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db', 'volume_size': 1} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-6388b1a0-a9b0-4a15-87c5-826ba72bc85c" released by "delete_volume" :: held 0.767s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['eed2ec22-56b7-4a52-a135-78eb511ee098', '1fda254a-079e-42bd-99cb-16e895750cae', 'b6f7fa67-04b8-4200-a623-ec149c46efe6', '4b9242af-36b2-4a79-b920-509a7b8fa0fc'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" returned: 0 in 0.386s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:49 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a 1G Nov 03 17:41:49 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:49 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "cinder-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5fd97f-251d-42c6-9cdb-708ed59bb245]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "cinder-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-490c7abb-d0ed-4fb8-980a-32671b7179a5 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-6388b1a0-a9b0-4a15-87c5-826ba72bc85c-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "cinder-quobyte-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "cinder-quobyte-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe980e9-be0c-4bc4-aec0-c7983737f6c7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f Nov 03 17:41:49 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a 1G" returned: 0 in 0.503s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a Nov 03 17:41:49 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 Nov 03 17:41:49 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f Nov 03 17:41:49 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" returned: 0 in 0.384s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a" returned: 0 in 0.340s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:49 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a is being set with open permissions: ugo+rw Nov 03 17:41:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:49 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00 Nov 03 17:41:49 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:49 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a Nov 03 17:41:49 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f" released by "delete_volume" :: held 0.728s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['96caa50a-7a0e-4dd0-95ec-35e449fa739d', 'e62ba042-bf8e-4c7f-8ccb-b36490d767d1', '4b73f8bf-6790-42f5-9d18-95cfb5204e15', 'dd0bacdd-70da-49ec-bfcb-0058503b2d47'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:50 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a" returned: 0 in 0.260s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "cinder-quobyte-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00" released by "delete_volume" :: held 0.687s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info Nov 03 17:41:50 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Created reservations ['caf3a5e3-4c32-44a2-876c-8544ac62756e', '619a454d-3976-49fa-be75-70a3c8f2ae74', '7a9df36a-b739-444d-ab4d-00491f0658c5', '54dfa12d-9023-4a77-a8dd-b92dd72ff561'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:50 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:50 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:50 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-1277a36c-32c4-42d0-a4fc-8d79428b96c7-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-1277a36c-32c4-42d0-a4fc-8d79428b96c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:50 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info" returned: 0 in 0.345s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info is being set with open permissions: ugo+rw Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info Nov 03 17:41:50 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-1277a36c-32c4-42d0-a4fc-8d79428b96c7" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:50 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.352s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-1277a36c-32c4-42d0-a4fc-8d79428b96c7" acquired by "delete_volume" :: waited 0.039s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-a2f13736-5599-4770-a5f9-d7720438f453 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-6f5f4cb1-bf89-45fd-b0ea-7c6acd05b11f-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bed637-35e1-41ae-bd42-22a61bad3d4c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.370s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Deleted volume successfully. Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c273e115-5c73-405f-8f90-388b935520f3 tempest-ProjectReaderTests-1635003593 None] Lock "cinder-f39fa7aa-ad15-4e6c-a210-9d1cbf2d4a00-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:50 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.info" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:50 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 Nov 03 17:41:50 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051149209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0a7033-05a5-47a8-a2c0-e9b8047fe5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:49Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Creating volume bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:50 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:50 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db 1073741824 Nov 03 17:41:50 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6d60be1a-9b39-4bef-a1fe-24a8b77c63bd tempest-ProjectReaderTests-562863205 None] Create snapshot completed successfully Nov 03 17:41:51 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7" returned: 0 in 0.492s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:51 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7 Nov 03 17:41:51 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Flow 'volume_create_manager' (46599905-4afb-4229-802f-b1fc8f5869d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2267ffa7-0677-4950-a82a-567e389ee7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2267ffa7-0677-4950-a82a-567e389ee7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630458888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b89c4e-a255-4bc1-a286-980f86d86642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d5d0f018524bf384d995dee0efa298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:51Z,use_quota=True,user_id='c03d35a595db4b24b88ef36bb7f02b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfdae29-d784-4f8c-afc6-dd6643655b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfdae29-d784-4f8c-afc6-dd6643655b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258aee3b-c8c0-420d-9a34-c38dedf9a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258aee3b-c8c0-420d-9a34-c38dedf9a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b89c4e-a255-4bc1-a286-980f86d86642', 'volume_name': 'volume-28b89c4e-a255-4bc1-a286-980f86d86642', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5734d68-95d0-45f2-a527-cdba5e1ff5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5734d68-95d0-45f2-a527-cdba5e1ff5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebf12a-0fb0-41a2-be36-40b92c144af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Volume 28b89c4e-a255-4bc1-a286-980f86d86642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b89c4e-a255-4bc1-a286-980f86d86642', 'volume_size': 1} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:51 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db 1073741824" returned: 0 in 0.472s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=226,cinder:UPDATE=299,cinder:INSERT=77,cinder:DELETE=30 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=240,cinder:UPDATE=316,cinder:DELETE=26,cinder:INSERT=88 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:51 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db Nov 03 17:41:51 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:51 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-1277a36c-32c4-42d0-a4fc-8d79428b96c7" returned: 0 in 0.275s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-1277a36c-32c4-42d0-a4fc-8d79428b96c7" released by "delete_volume" :: held 0.837s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['626b07ea-e56f-4f77-9260-5c5e0bf707a9', '20f6a3f1-2a10-4087-b5ea-b547bf4360a6', 'a74ce2d2-6ef9-4b60-9eaf-b1b3c4b87f3c', 'a6c05ef6-7430-45d7-925a-c718ab74355d'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:51 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:51 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:51 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-e9744918-bc9c-4f38-9054-33d8043b8727-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630458888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b89c4e-a255-4bc1-a286-980f86d86642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d5d0f018524bf384d995dee0efa298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:51Z,use_quota=True,user_id='c03d35a595db4b24b88ef36bb7f02b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Creating volume 28b89c4e-a255-4bc1-a286-980f86d86642 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:51 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:51 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 1073741824 Nov 03 17:41:51 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-e9744918-bc9c-4f38-9054-33d8043b8727-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa97803-162e-440c-ab33-11c831c7010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dede8119-2d10-45cf-8f72-3dfe7cace3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:51 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Volume volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db (bb0a7033-05a5-47a8-a2c0-e9b8047fe5db): created successfully Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dede8119-2d10-45cf-8f72-3dfe7cace3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (ae09a12a-a66e-4208-af49-cc8ea414cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f9480a58-c842-403a-8eba-c1ef40db132d tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-e9744918-bc9c-4f38-9054-33d8043b8727" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:51 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:51 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-e9744918-bc9c-4f38-9054-33d8043b8727" acquired by "delete_volume" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:51 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9434676-3721-4df9-87c4-71d51236a499]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-240f14f4-57c4-4c2d-b10f-cf49b483ce20 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-1277a36c-32c4-42d0-a4fc-8d79428b96c7-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-fbdeda58-39d3-4f95-9c41-015c623e3d1a-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-fbdeda58-39d3-4f95-9c41-015c623e3d1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-fbdeda58-39d3-4f95-9c41-015c623e3d1a" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-fbdeda58-39d3-4f95-9c41-015c623e3d1a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Deleting offline snapshot fbdeda58-39d3-4f95-9c41-015c623e3d1a of volume 0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] snapshot_file for this snap is: volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5370b-2f66-4ba4-adb4-f5c00655e13a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 Nov 03 17:41:52 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:52 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a Nov 03 17:41:52 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 1073741824" returned: 0 in 0.663s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 Nov 03 17:41:52 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727" returned: 0 in 0.506s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727 Nov 03 17:41:52 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a" returned: 0 in 0.456s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04140bf-5776-4e78-b6cc-fc7423c2b44d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 2abb6315-64fc-4432-8b3d-85e606752694 of volume bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebf12a-0fb0-41a2-be36-40b92c144af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b89c4e-a255-4bc1-a286-980f86d86642', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9607bc1b-11da-4fe6-ba3b-ceb70efda400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d895363-ab49-4e75-9aa2-451ea14984f0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:52 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Volume volume-28b89c4e-a255-4bc1-a286-980f86d86642 (28b89c4e-a255-4bc1-a286-980f86d86642): created successfully Nov 03 17:41:52 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9607bc1b-11da-4fe6-ba3b-ceb70efda400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Flow 'volume_create_manager' (46599905-4afb-4229-802f-b1fc8f5869d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-e9744918-bc9c-4f38-9054-33d8043b8727" returned: 0 in 0.285s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:52 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f Nov 03 17:41:52 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-454e8cec-db8c-4328-9cf5-05a0c88aaaf1 tempest-ProjectReaderTests-1635003593 None] Created volume successfully. Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-e9744918-bc9c-4f38-9054-33d8043b8727" released by "delete_volume" :: held 0.893s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:52 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db Nov 03 17:41:52 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['1bf89b52-9e07-4895-b4a7-87bdd7f6028c', '63bdd3dc-4005-45d4-97e6-fac0f6c62396', '5955dad9-8e7a-4d28-b2e4-7c3aebfbc263', 'ba50e4cd-2043-4abb-9ded-58e397ce4029'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:52 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:53 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a Nov 03 17:41:53 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 1G Nov 03 17:41:53 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.294s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-cc0290d7-e1db-4080-b2bd-21a09aea9877 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-e9744918-bc9c-4f38-9054-33d8043b8727-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Acquiring lock "cinder-28b89c4e-a255-4bc1-a286-980f86d86642-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "cinder-28b89c4e-a255-4bc1-a286-980f86d86642-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:53 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a Nov 03 17:41:53 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Acquiring lock "cinder-quobyte-28b89c4e-a255-4bc1-a286-980f86d86642" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "cinder-quobyte-28b89c4e-a255-4bc1-a286-980f86d86642" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f45d7d-f5b8-4a7d-9f86-d39756630c48]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 1G" returned: 0 in 0.533s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:53 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 Nov 03 17:41:53 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 Nov 03 17:41:53 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:53 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f.fbdeda58-39d3-4f95-9c41-015c623e3d1a" returned: 0 in 0.288s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-fbdeda58-39d3-4f95-9c41-015c623e3d1a" released by "_delete_snapshot" :: held 1.700s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" released by "delete_snapshot" :: held 1.736s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:53 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Created reservations ['c7b28331-07e8-4f5c-8ef8-a4c180e73ba9', '2c5e5d7c-e109-4c9a-a42e-2365133e2837', '6cf35b7f-b8dd-436e-a8bf-b42f8d2ee90f', '82af45ec-2757-42a4-9480-fceec30dc5b6'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:53 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Delete snapshot completed successfully. Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2f43d425-418c-4eeb-92a7-16265ef7a024 tempest-ProjectReaderTests-562863205 None] Lock "cinder-fbdeda58-39d3-4f95-9c41-015c623e3d1a-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:54 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642" returned: 0 in 0.445s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:54 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642 Nov 03 17:41:54 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "cinder-quobyte-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f618a3-087a-44f0-b796-1e00d3e779fc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:54 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694" returned: 0 in 0.446s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 is being set with open permissions: ugo+rw Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 Nov 03 17:41:54 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "cinder-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:54 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 Nov 03 17:41:54 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-28b89c4e-a255-4bc1-a286-980f86d86642" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "cinder-quobyte-28b89c4e-a255-4bc1-a286-980f86d86642" released by "delete_volume" :: held 0.796s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef953046-6479-4463-a1bb-0df9c5036d5f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Created reservations ['069036df-7d59-40ab-bbcc-92e33b759eb1', '68810366-149c-44a1-9280-3d8da1c5ca59', 'd63265b0-eb87-470b-a730-147a3e7a0ed4', '30b94e5a-6a50-4e52-a81d-aeeddbc4fdd8'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:54 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f Nov 03 17:41:54 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info Nov 03 17:41:54 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:54 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" returned: 0 in 0.536s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100 Nov 03 17:41:54 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info is being set with open permissions: ugo+rw Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:54 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info Nov 03 17:41:54 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:54 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:54 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:54 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Deleted volume successfully. Nov 03 17:41:55 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" returned: 0 in 0.583s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-86a09074-42ae-43e0-96b5-86c4884a2cbe tempest-ProjectReaderTests-1635003593 None] Lock "cinder-28b89c4e-a255-4bc1-a286-980f86d86642-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:55 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f Nov 03 17:41:55 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:55 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" returned: 0 in 0.385s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-quobyte-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100" released by "delete_volume" :: held 0.983s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:55 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.info" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Created reservations ['c7179e28-2780-43d9-9bb7-165050a0a952', '93d1bb2e-d7d1-473e-8b9e-5e48517fadc4', 'eda75c84-106b-43fe-8508-ae75c04b258d', '9ba101e6-4233-4b9f-9c14-a6497a2c5a08'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4daa4420-dd38-496c-8597-364f3ca8d50d tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:55 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:55 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:55 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" returned: 0 in 0.344s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f" released by "delete_volume" :: held 1.006s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Created reservations ['16c6858d-6e25-486f-9b9c-de03d7785c9f', 'a38d3969-33c1-4b9c-8347-c3da6fd03909', '6c7c2c10-6f8f-4996-a8dc-704f86e55363', 'd7e17e4b-967d-4df6-9ff8-6ebf387acc0a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-2abb6315-64fc-4432-8b3d-85e606752694-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:55 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:55 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:55 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.326s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Deleted volume successfully. Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-2abb6315-64fc-4432-8b3d-85e606752694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-2abb6315-64fc-4432-8b3d-85e606752694" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-3404b18a-63e5-4fcc-bfeb-89866ec09730 tempest-CreateVolumesFromSourceVolumeTest-1567060531 None] Lock "cinder-9b74fbd5-0ea2-48b2-9454-f5ad88ec7100-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-2abb6315-64fc-4432-8b3d-85e606752694" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 2abb6315-64fc-4432-8b3d-85e606752694 of volume bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[97297717-8694-4772-aa54-f2f48afb124e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:55 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 Nov 03 17:41:55 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:55 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.334s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Deleted volume successfully. Nov 03 17:41:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-99fa62a1-34de-45c9-8c0f-d0c9fbddd21b tempest-ProjectReaderTests-562863205 None] Lock "cinder-0553eee5-4d29-4d3f-bf8f-e6590c2c9b7f-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:56 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694" returned: 0 in 0.414s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[52819437-d159-4b5f-9027-951352672149]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:56 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db Nov 03 17:41:56 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:56 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" returned: 0 in 0.467s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:56 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 Nov 03 17:41:56 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:57 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694" returned: 0 in 0.519s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:57 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694 Nov 03 17:41:57 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (f0d7c5aa-188c-4e4f-8f86-1b95253a6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d846d1-dc1b-4c46-92f3-4fb406fae5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d846d1-dc1b-4c46-92f3-4fb406fae5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403717740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114eeb3e-3ed2-4f9c-b42d-ea6c56765aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:57Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5b69ca-d989-4b11-8439-5195af1f9536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5b69ca-d989-4b11-8439-5195af1f9536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac812ab-8083-4c93-b6ce-c6b6727ab3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac812ab-8083-4c93-b6ce-c6b6727ab3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114eeb3e-3ed2-4f9c-b42d-ea6c56765aab', 'volume_name': 'volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118be468-f134-48f9-ad1c-0abb03ecd66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118be468-f134-48f9-ad1c-0abb03ecd66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0ad87-a3eb-4653-8b4b-128c6c00ca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Volume 114eeb3e-3ed2-4f9c-b42d-ea6c56765aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab', 'volume_size': 1} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403717740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114eeb3e-3ed2-4f9c-b42d-ea6c56765aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:41:57Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Creating volume 114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:41:57 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:57 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab 1073741824 Nov 03 17:41:57 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:57 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db.2abb6315-64fc-4432-8b3d-85e606752694" returned: 0 in 0.298s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-2abb6315-64fc-4432-8b3d-85e606752694" released by "_delete_snapshot" :: held 1.838s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" released by "delete_snapshot" :: held 1.871s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Created reservations ['ed68584c-98d9-4dad-9482-4e2ddd840aa9', 'f86c5e98-7e46-4ec7-86a4-ea6010b79e98', 'f07d4671-2ef7-4d62-97e1-941024ad08a9', 'f50bea73-bb67-4e14-a40f-89ba43aa2448'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-05bfc97c-8482-472f-bac8-9cd548a242bc tempest-ProjectMemberTests-786257033 None] Lock "cinder-2abb6315-64fc-4432-8b3d-85e606752694-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "cinder-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:57 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab 1073741824" returned: 0 in 0.548s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[53175b14-d345-4b56-9f82-8c47da4ff4f1]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:57 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab Nov 03 17:41:57 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:58 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db Nov 03 17:41:58 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:58 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0ad87-a3eb-4653-8b4b-128c6c00ca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd7cf51-adbe-4273-9b58-ce27601c9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:58 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Volume volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab (114eeb3e-3ed2-4f9c-b42d-ea6c56765aab): created successfully Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd7cf51-adbe-4273-9b58-ce27601c9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (f0d7c5aa-188c-4e4f-8f86-1b95253a6754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d5961638-08cc-42af-bd6f-1f6f147d8c9a tempest-ProjectReaderTests-562863205 None] Created volume successfully. Nov 03 17:41:58 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" returned: 0 in 0.415s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:58 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db Nov 03 17:41:58 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:58 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" returned: 0 in 0.255s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db" released by "delete_volume" :: held 0.757s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Created reservations ['dc59f63c-da84-4b3a-b232-778fc4abbd03', '7cc1436c-5438-4a9e-b696-bcea1074b71a', '076362ac-e706-44f7-a21f-7963ac2423f4', '07121717-9277-42ca-bbe9-e0080aa2a8dd'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:41:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:58 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:41:58 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:59 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:41:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-dee5f124-4115-4041-9646-7733ba10575f tempest-ProjectMemberTests-786257033 None] Lock "cinder-bb0a7033-05a5-47a8-a2c0-e9b8047fe5db-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (34e26d33-87ad-4687-a5e7-62f1c1fd2d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a2325-9971-407e-8ef6-0ad7d1a2209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Creating offline snapshot f7e48429-e4e1-4576-b8c4-04779f9953bd of volume 114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a2325-9971-407e-8ef6-0ad7d1a2209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952472524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72537493-90a8-4cd4-a2c1-a8e88d1bcb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:00Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f58a40-b0da-4c18-bc45-8b0205771c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f58a40-b0da-4c18-bc45-8b0205771c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9f08da-16cb-4ccc-b94e-bfa73bb38546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9f08da-16cb-4ccc-b94e-bfa73bb38546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72537493-90a8-4cd4-a2c1-a8e88d1bcb35', 'volume_name': 'volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f82503c-7a04-43e9-9719-47f1cf95e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f82503c-7a04-43e9-9719-47f1cf95e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab32f5f8-c68a-4ad7-91f7-09af3cb375f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:41:59 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Volume 72537493-90a8-4cd4-a2c1-a8e88d1bcb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35', 'volume_size': 1} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a621f-550b-43c0-8e15-f9b6782c0c79]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:41:59 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab Nov 03 17:41:59 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:41:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-37d521e1-338b-4ceb-9a01-231345249de1 tempest-ProjectAdminTests-212399607 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5546951293945, 'free_capacity_gb': 1773.5546951293945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86995) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:42:00 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:00 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd 1G Nov 03 17:42:00 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:00 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd 1G" returned: 0 in 0.452s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:00 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd Nov 03 17:42:00 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:00 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:00 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd is being set with open permissions: ugo+rw Nov 03 17:42:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:00 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd Nov 03 17:42:00 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:01 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:01 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info Nov 03 17:42:01 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:01 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:01 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info is being set with open permissions: ugo+rw Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:01 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info Nov 03 17:42:01 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:01 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.info" returned: 0 in 0.288s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952472524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72537493-90a8-4cd4-a2c1-a8e88d1bcb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:00Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Creating volume 72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:01 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:01 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 1073741824 Nov 03 17:42:01 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-cd48385d-42ec-4d05-9700-73bb7dfd0543 tempest-ProjectReaderTests-562863205 None] Create snapshot completed successfully Nov 03 17:42:02 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 1073741824" returned: 0 in 0.459s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:02 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 Nov 03 17:42:02 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:02 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" returned: 0 in 0.257s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab32f5f8-c68a-4ad7-91f7-09af3cb375f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39293738-78a3-452d-a2ef-b693c534f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:02 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Volume volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 (72537493-90a8-4cd4-a2c1-a8e88d1bcb35): created successfully Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39293738-78a3-452d-a2ef-b693c534f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (34e26d33-87ad-4687-a5e7-62f1c1fd2d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-f7e48429-e4e1-4576-b8c4-04779f9953bd-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c988167a-03d5-49d8-bf9d-4d69647cce7c tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-f7e48429-e4e1-4576-b8c4-04779f9953bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-f7e48429-e4e1-4576-b8c4-04779f9953bd" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-f7e48429-e4e1-4576-b8c4-04779f9953bd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Deleting offline snapshot f7e48429-e4e1-4576-b8c4-04779f9953bd of volume 114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] snapshot_file for this snap is: volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c134209-cf0c-4c14-8708-c9989f891fa4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:02 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd Nov 03 17:42:02 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:03 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd" returned: 0 in 0.400s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[63491bd4-0121-4ace-9628-161824660c9d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:03 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab Nov 03 17:42:03 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:03 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" returned: 0 in 0.391s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:03 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd Nov 03 17:42:03 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:04 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 01ef82cb-55cc-4686-83df-f48ac7e1f2f7 of volume 72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd" returned: 0 in 0.435s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3193acf-b54c-4687-ada8-c3bef4d189f5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:04 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd Nov 03 17:42:04 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:04 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 Nov 03 17:42:04 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:04 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab.f7e48429-e4e1-4576-b8c4-04779f9953bd" returned: 0 in 0.263s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-f7e48429-e4e1-4576-b8c4-04779f9953bd" released by "_delete_snapshot" :: held 1.610s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" released by "delete_snapshot" :: held 1.643s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Created reservations ['5a111d9c-50ec-4809-b861-c7931e1299f6', 'e8f7d879-e890-44fd-aa0c-7bb9e2174566', 'd77ea462-e6e3-4beb-94a0-6723d0280969', '76e8892b-6871-4966-871a-797d8f2c5590'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:04 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Delete snapshot completed successfully. Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18b2b162-96fa-40da-9812-583c08a3a433 tempest-ProjectReaderTests-562863205 None] Lock "cinder-f7e48429-e4e1-4576-b8c4-04779f9953bd-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:04 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" returned: 0 in 0.450s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:04 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 1G Nov 03 17:42:04 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "cinder-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:04 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c6cdb-1e41-4043-930c-f1e6d23af4db]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:05 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 1G" returned: 0 in 0.559s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:05 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 Nov 03 17:42:05 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:05 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab Nov 03 17:42:05 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:05 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:05 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 is being set with open permissions: ugo+rw Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:05 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" returned: 0 in 0.412s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:05 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 Nov 03 17:42:05 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:05 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab Nov 03 17:42:05 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:05 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7" returned: 0 in 0.324s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:05 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" returned: 0 in 0.324s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab" released by "delete_volume" :: held 0.838s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:05 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info Nov 03 17:42:05 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Created reservations ['0d6fd6ab-4a71-4b3e-a34f-bbb09a56018b', 'b5e059bc-7c02-49c7-bb41-9dd5829c0754', '05843339-b819-4a53-a816-763f2fbcdbbf', '64c7b23b-f6a0-4a65-8ae5-61e33948b6a7'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:05 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:06 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:06 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:06 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info" returned: 0 in 0.317s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:06 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info is being set with open permissions: ugo+rw Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:06 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info Nov 03 17:42:06 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:06 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.375s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Deleted volume successfully. Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-1fdd7ff6-3319-4eed-8b3d-2b1c9c7206d5 tempest-ProjectReaderTests-562863205 None] Lock "cinder-114eeb3e-3ed2-4f9c-b42d-ea6c56765aab-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:06 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.info" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:06 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4251202c-c32d-4f8f-bdd8-8f2d0d7575b7 tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (0e4f3198-722d-46fe-95c0-eedf5fd8b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526855c0-97b5-41d4-a509-3ba67dfdf42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526855c0-97b5-41d4-a509-3ba67dfdf42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895054715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7ef2e-0da0-4423-9694-85bba9b91d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:07Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adca62a-db13-4462-ae3c-dd3d09b123e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adca62a-db13-4462-ae3c-dd3d09b123e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06ed544-5178-44a3-be9c-8e6ce50d10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06ed544-5178-44a3-be9c-8e6ce50d10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a7ef2e-0da0-4423-9694-85bba9b91d88', 'volume_name': 'volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c806ed62-eee1-441a-b501-d293a7f9f22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c806ed62-eee1-441a-b501-d293a7f9f22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db72479-d528-44bd-96cd-1526a0a7c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:06 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Volume d6a7ef2e-0da0-4423-9694-85bba9b91d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88', 'volume_size': 1} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895054715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7ef2e-0da0-4423-9694-85bba9b91d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:07Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Creating volume d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:06 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:06 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:06 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 1073741824 Nov 03 17:42:06 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-01ef82cb-55cc-4686-83df-f48ac7e1f2f7-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-01ef82cb-55cc-4686-83df-f48ac7e1f2f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:07 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 1073741824" returned: 0 in 0.499s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-01ef82cb-55cc-4686-83df-f48ac7e1f2f7" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-01ef82cb-55cc-4686-83df-f48ac7e1f2f7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 01ef82cb-55cc-4686-83df-f48ac7e1f2f7 of volume 72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cad2a0-957e-4963-8dbc-c05c86740359]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:07 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 Nov 03 17:42:07 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:07 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 Nov 03 17:42:07 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:07 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88" returned: 0 in 0.300s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db72479-d528-44bd-96cd-1526a0a7c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42101b1d-6779-4ba5-9ada-beab416bad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:07 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Volume volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 (d6a7ef2e-0da0-4423-9694-85bba9b91d88): created successfully Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42101b1d-6779-4ba5-9ada-beab416bad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (0e4f3198-722d-46fe-95c0-eedf5fd8b73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:07 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2c4751dd-3e0f-42f6-9915-f390bd8b5c86 tempest-ProjectReaderTests-562863205 None] Created volume successfully. Nov 03 17:42:07 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7" returned: 0 in 0.424s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b71451-3eac-4623-855b-1ade825fcf3d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:07 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:07 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 Nov 03 17:42:07 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:08 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:08 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 Nov 03 17:42:08 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:08 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7" returned: 0 in 0.357s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:08 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7 Nov 03 17:42:08 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:08 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35.01ef82cb-55cc-4686-83df-f48ac7e1f2f7" returned: 0 in 0.292s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-01ef82cb-55cc-4686-83df-f48ac7e1f2f7" released by "_delete_snapshot" :: held 1.569s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" released by "delete_snapshot" :: held 1.609s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Creating offline snapshot 213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f of volume d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a3b64-51ce-491f-a319-688678bc79a0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:08 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Created reservations ['3f7a924e-5939-4b93-8444-f536450bf73b', '66d601b5-647a-43a8-add4-edc46daee493', '59ab92a9-c4d9-4f38-86bd-cbcd441f7e3d', '6ed82b6c-322e-4c2f-b895-cee37d97bd30'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:09 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-18fbad8b-ccb8-4bc9-9afa-f210bcc96ae8 tempest-ProjectMemberTests-786257033 None] Lock "cinder-01ef82cb-55cc-4686-83df-f48ac7e1f2f7-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:09 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 Nov 03 17:42:09 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:09 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88" returned: 0 in 0.358s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:09 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f 1G Nov 03 17:42:09 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-72537493-90a8-4cd4-a2c1-a8e88d1bcb35-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "cinder-72537493-90a8-4cd4-a2c1-a8e88d1bcb35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0085546-d9b4-4ff6-9018-28e1b587941e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:09 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 Nov 03 17:42:09 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:09 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f 1G" returned: 0 in 0.495s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:09 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:09 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f Nov 03 17:42:09 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:10 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:10 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35 Nov 03 17:42:10 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:10 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" returned: 0 in 0.336s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f is being set with open permissions: ugo+rw Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:10 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f Nov 03 17:42:10 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:10 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" returned: 0 in 0.292s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-72537493-90a8-4cd4-a2c1-a8e88d1bcb35" released by "delete_volume" :: held 0.809s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Created reservations ['30b6cc83-59a5-4b37-92e9-a9767a32b89b', '94d38b47-3669-4704-b5f1-2e0d813b194a', 'd44f4f78-7a50-400c-b155-fcc3f43559b0', 'dc2d3cb5-2035-43c7-b479-9e7c87d1e94c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:10 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" returned: 0 in 0.303s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:10 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:10 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info Nov 03 17:42:10 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:10 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:10 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e9dd4f1f-0035-4d61-9fb6-376eebf13699 tempest-ProjectMemberTests-786257033 None] Lock "cinder-72537493-90a8-4cd4-a2c1-a8e88d1bcb35-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:10 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info" returned: 0 in 0.276s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:10 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info is being set with open permissions: ugo+rw Nov 03 17:42:10 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:10 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info Nov 03 17:42:10 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:11 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.info" returned: 0 in 0.247s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:11 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-86e764e2-0bab-4e07-9330-d3e37926e73f tempest-ProjectReaderTests-562863205 None] Create snapshot completed successfully Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (4f0a5f35-5fd7-4a66-8aac-9f71ff532190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c55ee95-95d5-44e3-bd8a-816a06a63624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c55ee95-95d5-44e3-bd8a-816a06a63624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038463818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27485acc-8807-4e14-8107-3492207cbdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:11Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f75191-2885-4c8a-a6f4-a0f7ee96b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f75191-2885-4c8a-a6f4-a0f7ee96b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028be2f4-fd01-4298-b663-7535f577112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028be2f4-fd01-4298-b663-7535f577112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27485acc-8807-4e14-8107-3492207cbdb1', 'volume_name': 'volume-27485acc-8807-4e14-8107-3492207cbdb1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09620c5c-0c38-4967-b3cd-c1e899a1b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09620c5c-0c38-4967-b3cd-c1e899a1b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d80c931-a525-401f-b156-3cca9bdc0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Volume 27485acc-8807-4e14-8107-3492207cbdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27485acc-8807-4e14-8107-3492207cbdb1', 'volume_size': 1} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038463818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27485acc-8807-4e14-8107-3492207cbdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:11Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Creating volume 27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:11 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:11 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 1073741824 Nov 03 17:42:11 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:11 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 1073741824" returned: 0 in 0.435s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:11 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 Nov 03 17:42:11 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:11 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1" returned: 0 in 0.249s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d80c931-a525-401f-b156-3cca9bdc0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27485acc-8807-4e14-8107-3492207cbdb1', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da7edef-f027-4797-9161-7734d4b8e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:11 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Volume volume-27485acc-8807-4e14-8107-3492207cbdb1 (27485acc-8807-4e14-8107-3492207cbdb1): created successfully Nov 03 17:42:11 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da7edef-f027-4797-9161-7734d4b8e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (4f0a5f35-5fd7-4a66-8aac-9f71ff532190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:12 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-56ca6be7-757d-4f0b-bf7e-7575b372b3c2 tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Deleting offline snapshot 213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f of volume d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] snapshot_file for this snap is: volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd8b4d-7ac2-40fb-9153-22635b55ca02]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 035752e7-28d1-4040-b03e-382d766b5141 of volume 27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443489d-18ce-4e0d-a745-0a4547ddd175]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:12 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f Nov 03 17:42:12 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:12 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 Nov 03 17:42:12 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:12 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" returned: 0 in 0.405s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[40106d04-074d-43cd-be60-23fc2ef93d5d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:12 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:12 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:12 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 1G Nov 03 17:42:12 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:12 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 Nov 03 17:42:12 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:13 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:13 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f Nov 03 17:42:13 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:13 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 1G" returned: 0 in 0.486s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27485acc-8807-4e14-8107-3492207cbdb1 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:13 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27485acc-8807-4e14-8107-3492207cbdb1 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 Nov 03 17:42:13 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:13 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" returned: 0 in 0.384s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:13 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f Nov 03 17:42:13 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:13 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27485acc-8807-4e14-8107-3492207cbdb1 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141" returned: 0 in 0.365s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:13 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 is being set with open permissions: ugo+rw Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:13 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 Nov 03 17:42:13 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:13 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:13 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88.213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" returned: 0 in 0.312s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f" released by "_delete_snapshot" :: held 1.655s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" released by "delete_snapshot" :: held 1.695s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:14 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141" returned: 0 in 0.290s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Created reservations ['e253f2ca-03f7-4a55-a58b-67039495ba00', '73dd5af0-f1d2-4d21-a8fe-c2b7a235590e', 'bb10875d-f580-4993-9744-e936f934365c', '6b0720fc-bbd0-4f67-a3d5-d9343fab4d65'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:14 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info Nov 03 17:42:14 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Delete snapshot completed successfully. Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-03c78a76-c2ce-4b46-84f7-933f3989a36e tempest-ProjectReaderTests-562863205 None] Lock "cinder-213c98a2-4af8-4c31-a7e7-70d2eaf1aa0f-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:14 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info" returned: 0 in 0.295s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:14 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info is being set with open permissions: ugo+rw Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:14 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info Nov 03 17:42:14 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-d6a7ef2e-0da0-4423-9694-85bba9b91d88-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "cinder-d6a7ef2e-0da0-4423-9694-85bba9b91d88-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" acquired by "delete_volume" :: waited 0.025s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[068aabbf-a896-4fbf-8594-653a2bea81b5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:14 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.info" returned: 0 in 0.325s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:14 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:14 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-5979f687-3b63-4bef-a19e-2ffecabfafd8 tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:14 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 Nov 03 17:42:14 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:15 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88" returned: 0 in 0.450s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:15 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88 Nov 03 17:42:15 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:15 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-d6a7ef2e-0da0-4423-9694-85bba9b91d88" returned: 0 in 0.361s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-035752e7-28d1-4040-b03e-382d766b5141-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-d6a7ef2e-0da0-4423-9694-85bba9b91d88" released by "delete_volume" :: held 0.940s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-035752e7-28d1-4040-b03e-382d766b5141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-035752e7-28d1-4040-b03e-382d766b5141" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Created reservations ['3086f54c-af2e-4564-9b25-e04f335d9371', 'a5ce6470-e531-48d6-982a-3d526efd43d3', '541ff037-722b-4a9f-b6bc-e8d6272c79b8', '358db105-f2be-4014-8bbe-bdb24c58230a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-035752e7-28d1-4040-b03e-382d766b5141" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 035752e7-28d1-4040-b03e-382d766b5141 of volume 27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[038cbdc9-15b8-4d91-ad6f-2d08244736aa]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:15 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:15 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:15 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:15 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 Nov 03 17:42:15 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:16 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.276s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:16 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Deleted volume successfully. Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6fbae07e-3e7d-4a53-9567-be4cfec4357b tempest-ProjectReaderTests-562863205 None] Lock "cinder-d6a7ef2e-0da0-4423-9694-85bba9b91d88-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:16 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141" returned: 0 in 0.423s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27485acc-8807-4e14-8107-3492207cbdb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[20663637-67c2-4388-b527-1b220e947a76]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:16 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 Nov 03 17:42:16 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:16 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:16 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:16 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 Nov 03 17:42:16 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:17 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141" returned: 0 in 0.435s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:17 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141 Nov 03 17:42:17 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:17 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1.035752e7-28d1-4040-b03e-382d766b5141" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-035752e7-28d1-4040-b03e-382d766b5141" released by "_delete_snapshot" :: held 1.678s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" released by "delete_snapshot" :: held 1.721s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (650b88ac-bfb0-4317-8ead-692c86d691c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa442ed-a415-4131-bef6-20dfa62dd200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa442ed-a415-4131-bef6-20dfa62dd200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856142039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b6dab8-5028-4deb-82a0-9c91c54589f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:17Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1b8d5b-b7e8-4be5-aec6-aa789ec10584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1b8d5b-b7e8-4be5-aec6-aa789ec10584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd22f3e-be68-4fc2-bb73-133072f62fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd22f3e-be68-4fc2-bb73-133072f62fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b6dab8-5028-4deb-82a0-9c91c54589f9', 'volume_name': 'volume-19b6dab8-5028-4deb-82a0-9c91c54589f9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9c9bfe-a1f8-47e4-b1c6-eb3e544f7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9c9bfe-a1f8-47e4-b1c6-eb3e544f7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11892dd2-ecb2-4ba7-b70f-6f340d1857f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:17 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Volume 19b6dab8-5028-4deb-82a0-9c91c54589f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b6dab8-5028-4deb-82a0-9c91c54589f9', 'volume_size': 1} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856142039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b6dab8-5028-4deb-82a0-9c91c54589f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:17Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Creating volume 19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:17 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:17 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 1073741824 Nov 03 17:42:17 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Created reservations ['5e37ce71-03c9-48bb-88ed-681b61d6452a', '7100d4ec-642c-4ba2-9653-a3d7c451e838', '67860323-57bf-4c87-a59e-2b47cffb4483', '35fa6d38-575a-4959-bb3b-53c44154a21c'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:17 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-6a8d8013-0877-4ef1-8719-3940bbe710c2 tempest-ProjectMemberTests-786257033 None] Lock "cinder-035752e7-28d1-4040-b03e-382d766b5141-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-27485acc-8807-4e14-8107-3492207cbdb1-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "cinder-27485acc-8807-4e14-8107-3492207cbdb1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090b494-7efa-452e-9ee1-1cd1f37adc8f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:17 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:18 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 1073741824" returned: 0 in 0.555s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:18 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 Nov 03 17:42:18 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:18 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 Nov 03 17:42:18 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:18 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:18 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:18 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1 Nov 03 17:42:18 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11892dd2-ecb2-4ba7-b70f-6f340d1857f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b6dab8-5028-4deb-82a0-9c91c54589f9', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436d8e6f-3883-40ad-b00f-456e8578f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:18 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Volume volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 (19b6dab8-5028-4deb-82a0-9c91c54589f9): created successfully Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436d8e6f-3883-40ad-b00f-456e8578f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (650b88ac-bfb0-4317-8ead-692c86d691c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:18 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fd90e1c5-ade4-4786-9ed3-ec5f59d9e921 tempest-ProjectReaderTests-562863205 None] Created volume successfully. Nov 03 17:42:18 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-27485acc-8807-4e14-8107-3492207cbdb1" returned: 0 in 0.258s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-27485acc-8807-4e14-8107-3492207cbdb1" released by "delete_volume" :: held 0.787s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Created reservations ['4270e9d5-f913-43d2-a4c2-c6554393f390', '6b85cbe3-8edd-4ad5-984f-a61a2351968e', '191b89e7-a54c-4ed2-a7c4-763b35352dae', '04595cb0-daa2-49df-beb4-41dd9391cc56'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:18 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:18 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:18 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:19 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:19 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fcc33aa-a6f1-465b-88a7-55379a56b6aa tempest-ProjectMemberTests-786257033 None] Lock "cinder-27485acc-8807-4e14-8107-3492207cbdb1-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (47e32697-b49e-4abb-80ff-204b73fe8baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa376e1-9e18-48e8-8bea-cee0521746a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa376e1-9e18-48e8-8bea-cee0521746a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034095454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c4d96e-a18e-49ba-83a9-20addf2ffcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:19Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed9fe96-22d1-4465-ad9b-05281c0f68ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed9fe96-22d1-4465-ad9b-05281c0f68ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7fd424-a2ee-47a8-961e-8be2da42f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7fd424-a2ee-47a8-961e-8be2da42f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c4d96e-a18e-49ba-83a9-20addf2ffcf6', 'volume_name': 'volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abbaaa-a4bf-43f2-a706-edf0f1498847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abbaaa-a4bf-43f2-a706-edf0f1498847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ecad9c-1990-47b8-8629-6efb66fe1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:19 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Volume 44c4d96e-a18e-49ba-83a9-20addf2ffcf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6', 'volume_size': 1} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034095454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c4d96e-a18e-49ba-83a9-20addf2ffcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:19Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Creating volume 44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:19 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:19 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 1073741824 Nov 03 17:42:19 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:19 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:20 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 1073741824" returned: 0 in 0.445s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:20 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 Nov 03 17:42:20 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:20 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.752s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ecad9c-1990-47b8-8629-6efb66fe1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d962737d-2773-4b55-80e4-fabac3dde250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Creating offline snapshot 73f175f1-d917-44c8-abc7-8b4b2d55791d of volume 19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:20 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Volume volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 (44c4d96e-a18e-49ba-83a9-20addf2ffcf6): created successfully Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d962737d-2773-4b55-80e4-fabac3dde250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (47e32697-b49e-4abb-80ff-204b73fe8baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb957a-75e7-4d37-8f8f-c0c42707e160]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:20 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-274cd8ae-052f-4e1b-9630-e7dc26ebabfe tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:20 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 Nov 03 17:42:20 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:20 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9" returned: 0 in 0.394s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:20 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:20 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d 1G Nov 03 17:42:20 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:21 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d 1G" returned: 0 in 0.398s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:21 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d Nov 03 17:42:21 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:21 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d" returned: 0 in 0.488s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:21 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d is being set with open permissions: ugo+rw Nov 03 17:42:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:21 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d Nov 03 17:42:21 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:21 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:22 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d" returned: 0 in 0.314s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:22 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info Nov 03 17:42:22 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:22 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:22 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info is being set with open permissions: ugo+rw Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:22 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info Nov 03 17:42:22 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:22 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.info" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Creating offline snapshot a3efba71-9615-4ebe-9724-f93c95daeef8 of volume 44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:22 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ad835915-8cc2-4b9c-ba2f-283039513f1d tempest-ProjectReaderTests-562863205 None] Create snapshot completed successfully Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba279584-69ba-4d6d-8d40-8689778f0c86]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:22 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 Nov 03 17:42:22 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-73f175f1-d917-44c8-abc7-8b4b2d55791d-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-73f175f1-d917-44c8-abc7-8b4b2d55791d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-73f175f1-d917-44c8-abc7-8b4b2d55791d" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-73f175f1-d917-44c8-abc7-8b4b2d55791d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Deleting offline snapshot 73f175f1-d917-44c8-abc7-8b4b2d55791d of volume 19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] snapshot_file for this snap is: volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[82171122-36bc-4574-b7c8-99f2211a86eb]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:22 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:23 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d Nov 03 17:42:23 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:23 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" returned: 0 in 0.513s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:23 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 1G Nov 03 17:42:23 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:23 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d" returned: 0 in 0.425s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19b6dab8-5028-4deb-82a0-9c91c54589f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ec7ab-4f12-40a7-83d8-485eccd452fc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:23 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 Nov 03 17:42:23 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:23 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 1G" returned: 0 in 0.628s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:23 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:23 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 Nov 03 17:42:23 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9" returned: 0 in 0.597s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:24 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d Nov 03 17:42:24 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8" returned: 0 in 0.377s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 is being set with open permissions: ugo+rw Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:24 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 Nov 03 17:42:24 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:24 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d Nov 03 17:42:24 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8" returned: 0 in 0.302s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:24 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info Nov 03 17:42:24 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9.73f175f1-d917-44c8-abc7-8b4b2d55791d" returned: 0 in 0.286s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-73f175f1-d917-44c8-abc7-8b4b2d55791d" released by "_delete_snapshot" :: held 1.880s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" released by "delete_snapshot" :: held 1.914s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:24 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info" returned: 0 in 0.306s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:24 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info is being set with open permissions: ugo+rw Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Created reservations ['1dea8bab-0fd5-46cd-a171-d66a9eb34e31', '0185f85b-5b2a-4bc6-a50a-f45168097399', '1d6a8a3e-ba9b-4dda-a103-7979a0024fe8', '23742207-b566-4e0f-a938-dbe29c0a17f0'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:24 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info Nov 03 17:42:24 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:24 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Delete snapshot completed successfully. Nov 03 17:42:24 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-331b6feb-4e54-473b-b106-d792c4f20558 tempest-ProjectReaderTests-562863205 None] Lock "cinder-73f175f1-d917-44c8-abc7-8b4b2d55791d-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-19b6dab8-5028-4deb-82a0-9c91c54589f9-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "cinder-19b6dab8-5028-4deb-82a0-9c91c54589f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" acquired by "delete_volume" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:25 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.info" returned: 0 in 0.333s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f527deb-017f-41ca-ac7c-d3a07df50ef9]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:25 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-4af530c1-3cb4-4ce5-8060-f3481c61a7dc tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:25 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 Nov 03 17:42:25 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:25 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9" returned: 0 in 0.416s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:25 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9 Nov 03 17:42:25 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:25 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-19b6dab8-5028-4deb-82a0-9c91c54589f9" returned: 0 in 0.291s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:25 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-19b6dab8-5028-4deb-82a0-9c91c54589f9" released by "delete_volume" :: held 0.813s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Created reservations ['6e0e21af-1550-464e-b891-41ed2698f220', '71965380-077a-4263-9f7f-eac2f3b7ebec', '4a21edec-0d39-402a-9ae2-dd21082b2f4e', 'fdcd1491-47b7-4929-8bb1-bd14b978fb29'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-a3efba71-9615-4ebe-9724-f93c95daeef8-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:26 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:26 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-a3efba71-9615-4ebe-9724-f93c95daeef8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-a3efba71-9615-4ebe-9724-f93c95daeef8" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-a3efba71-9615-4ebe-9724-f93c95daeef8" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot a3efba71-9615-4ebe-9724-f93c95daeef8 of volume 44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3042860-0aff-4e75-99a2-8082928fafa5]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:26 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 Nov 03 17:42:26 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:26 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.398s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:26 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Deleted volume successfully. Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-17507d36-00ea-46da-82de-411427e8df30 tempest-ProjectReaderTests-562863205 None] Lock "cinder-19b6dab8-5028-4deb-82a0-9c91c54589f9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:26 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (53cbd03e-a36f-470c-88c5-d5b09ff18ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4556814f-ac8e-4ea1-aad0-a5b612e04417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8" returned: 0 in 0.637s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:26 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4556814f-ac8e-4ea1-aad0-a5b612e04417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672455101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e5655d-37c4-41a0-a0ed-c608e990767e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:27Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df2cb5-75de-4ef6-98f7-2c9e90a6fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df2cb5-75de-4ef6-98f7-2c9e90a6fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c97ed-aee4-42e0-a74f-84ea01737ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c97ed-aee4-42e0-a74f-84ea01737ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e5655d-37c4-41a0-a0ed-c608e990767e', 'volume_name': 'volume-66e5655d-37c4-41a0-a0ed-c608e990767e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c56261-a894-4db8-afd4-3f8150731477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c56261-a894-4db8-afd4-3f8150731477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161c826-2a4d-4bf9-93b8-d22783572e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:27 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Volume 66e5655d-37c4-41a0-a0ed-c608e990767e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e5655d-37c4-41a0-a0ed-c608e990767e', 'volume_size': 1} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672455101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e5655d-37c4-41a0-a0ed-c608e990767e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b0bb421cf46ecab6aee0c4f925527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:27Z,use_quota=True,user_id='ddc71b23b3f140698a6cb2a767e58a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Creating volume 66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:27 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf21d5c-e054-4fad-976a-451be098df16]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:27 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e 1073741824 Nov 03 17:42:27 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:27 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 Nov 03 17:42:27 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:27 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" returned: 0 in 0.441s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:27 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 Nov 03 17:42:27 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:27 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e 1073741824" returned: 0 in 0.552s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:27 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e Nov 03 17:42:27 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:27 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e" returned: 0 in 0.279s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:27 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161c826-2a4d-4bf9-93b8-d22783572e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e5655d-37c4-41a0-a0ed-c608e990767e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3abb4a1-b4e6-4131-9cd0-f5fe7ae75585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8" returned: 0 in 0.450s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:27 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:28 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Volume volume-66e5655d-37c4-41a0-a0ed-c608e990767e (66e5655d-37c4-41a0-a0ed-c608e990767e): created successfully Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3abb4a1-b4e6-4131-9cd0-f5fe7ae75585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:28 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8 Nov 03 17:42:28 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Flow 'volume_create_manager' (53cbd03e-a36f-470c-88c5-d5b09ff18ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-622c09b3-3824-44e4-8563-5469ba920a7f tempest-ProjectReaderTests-562863205 None] Created volume successfully. Nov 03 17:42:28 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6.a3efba71-9615-4ebe-9724-f93c95daeef8" returned: 0 in 0.310s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-a3efba71-9615-4ebe-9724-f93c95daeef8" released by "_delete_snapshot" :: held 2.069s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" released by "delete_snapshot" :: held 2.115s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Created reservations ['b50fcb44-3f9f-4710-af79-48324f9e13ef', 'cea1be03-0007-4b74-a2db-9293ac55bb03', '1614eb0d-99c3-46b0-bad4-00203d4f61db', 'c89108ef-4be5-4302-8d8f-4dfa1be86da1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:28 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:42:28 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-42672a65-d437-4214-90d8-9fa1599e71d7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-a3efba71-9615-4ebe-9724-f93c95daeef8-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Creating offline snapshot 11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c of volume 66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182d04b-4151-4117-98dc-9a0d85ae3276]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:29 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e Nov 03 17:42:29 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-44c4d96e-a18e-49ba-83a9-20addf2ffcf6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-44c4d96e-a18e-49ba-83a9-20addf2ffcf6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3afa398-ad55-439c-93b7-170838e467dc]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:29 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e" returned: 0 in 0.428s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:29 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:29 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c 1G Nov 03 17:42:29 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:29 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 Nov 03 17:42:29 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:30 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" returned: 0 in 0.399s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:30 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6 Nov 03 17:42:30 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:30 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c 1G" returned: 0 in 0.478s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5655d-37c4-41a0-a0ed-c608e990767e -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:30 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5655d-37c4-41a0-a0ed-c608e990767e -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c Nov 03 17:42:30 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:30 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-44c4d96e-a18e-49ba-83a9-20addf2ffcf6" released by "delete_volume" :: held 0.757s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Created reservations ['059cdd4e-abfe-47e9-9cbe-e2424872d41c', 'e9fa2b1c-86a7-4136-a236-81999e541fa6', '3395ad31-1f91-47ce-b05a-c11e01c2046b', '385da66b-29e3-43ea-b638-0e66cfb2bc30'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:30 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:30 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:30 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5655d-37c4-41a0-a0ed-c608e990767e -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" returned: 0 in 0.392s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c is being set with open permissions: ugo+rw Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:30 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c Nov 03 17:42:30 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:30 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.301s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:30 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b0e05d53-0193-413c-8e81-3268f62cdea7 tempest-ProjectMemberTests-786257033 None] Lock "cinder-44c4d96e-a18e-49ba-83a9-20addf2ffcf6-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:30 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" returned: 0 in 0.295s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:30 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:30 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info Nov 03 17:42:30 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (390fcecf-35a5-4bff-85a7-7cbee1d004c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8d450-b366-45d7-911f-fd0fab1817f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8d450-b366-45d7-911f-fd0fab1817f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847347598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e46c4df-d1a1-4a17-a914-4369e622b99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:31Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505c7a0b-9cbf-4982-812f-70305e543bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505c7a0b-9cbf-4982-812f-70305e543bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:31 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b23da-4570-4fd0-9214-b313997b71fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b23da-4570-4fd0-9214-b313997b71fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e46c4df-d1a1-4a17-a914-4369e622b99b', 'volume_name': 'volume-8e46c4df-d1a1-4a17-a914-4369e622b99b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6341ec-7d7e-414f-ba4c-1b5e99d9ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6341ec-7d7e-414f-ba4c-1b5e99d9ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0a9ecd-4ed9-49fa-9ba5-41e765ddd751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:31 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Volume 8e46c4df-d1a1-4a17-a914-4369e622b99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e46c4df-d1a1-4a17-a914-4369e622b99b', 'volume_size': 1} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:31 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info is being set with open permissions: ugo+rw Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:31 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info Nov 03 17:42:31 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:31 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.info" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847347598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e46c4df-d1a1-4a17-a914-4369e622b99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:31Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Creating volume 8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:31 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:31 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:31 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b 1073741824 Nov 03 17:42:31 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:31 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b229d966-d451-4e93-a928-3157191b000a tempest-ProjectReaderTests-562863205 None] Create snapshot completed successfully Nov 03 17:42:32 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b 1073741824" returned: 0 in 0.454s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:32 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b Nov 03 17:42:32 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:32 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b" returned: 0 in 0.246s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0a9ecd-4ed9-49fa-9ba5-41e765ddd751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e46c4df-d1a1-4a17-a914-4369e622b99b', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22afa38-1444-4c51-902e-9edde95fa6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:32 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Volume volume-8e46c4df-d1a1-4a17-a914-4369e622b99b (8e46c4df-d1a1-4a17-a914-4369e622b99b): created successfully Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22afa38-1444-4c51-902e-9edde95fa6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (390fcecf-35a5-4bff-85a7-7cbee1d004c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:32 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-182fcf2d-b9ff-4ff3-9235-7362c53e8077 tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Deleting offline snapshot 11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c of volume 66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] snapshot_file for this snap is: volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fcf0b-acbc-4cb7-82e8-af0adc660cc7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:32 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:32 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c Nov 03 17:42:32 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:33 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" returned: 0 in 0.465s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e5655d-37c4-41a0-a0ed-c608e990767e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec595f0a-81d9-4279-a87c-3625ea31c9a0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:33 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e Nov 03 17:42:33 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:33 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 1dc10776-8885-4a8c-8471-aaa81ae2cdcc of volume 8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:33 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c Nov 03 17:42:33 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45a148-0cc5-4193-902f-e2073db5b133]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:33 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b Nov 03 17:42:33 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:33 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" returned: 0 in 0.362s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:33 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c Nov 03 17:42:33 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:33 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b" returned: 0 in 0.438s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:33 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:34 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc 1G Nov 03 17:42:34 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:34 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e.11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" returned: 0 in 0.267s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c" released by "_delete_snapshot" :: held 1.644s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" released by "delete_snapshot" :: held 1.670s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Created reservations ['52a66c9a-49f4-405b-a2ac-70aec09d45a2', '09ba1ea9-0b81-4c6d-b997-d1e2a929193a', '51d2104f-831a-45e9-884f-36c57ceab6ed', '8d1afe4c-a2a7-4203-a39a-bad2ca8da433'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:34 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Delete snapshot completed successfully. Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-298321bc-71cd-4716-a691-9322c77ad71f tempest-ProjectReaderTests-562863205 None] Lock "cinder-11cc868c-c4f5-4d3a-b3cc-fd43ec7fd50c-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:34 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc 1G" returned: 0 in 0.485s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e46c4df-d1a1-4a17-a914-4369e622b99b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:34 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e46c4df-d1a1-4a17-a914-4369e622b99b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc Nov 03 17:42:34 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-66e5655d-37c4-41a0-a0ed-c608e990767e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "cinder-66e5655d-37c4-41a0-a0ed-c608e990767e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Acquiring lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" acquired by "delete_volume" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:34 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e46c4df-d1a1-4a17-a914-4369e622b99b -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc" returned: 0 in 0.360s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:34 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc is being set with open permissions: ugo+rw Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee7d04-23ad-4c31-82b4-b8c1a8988e27]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:34 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:34 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc Nov 03 17:42:34 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:34 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e Nov 03 17:42:34 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:35 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc" returned: 0 in 0.251s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:35 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info Nov 03 17:42:35 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:35 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e" returned: 0 in 0.475s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:35 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e Nov 03 17:42:35 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:35 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info" returned: 0 in 0.311s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:35 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info is being set with open permissions: ugo+rw Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:35 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info Nov 03 17:42:35 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:35 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-66e5655d-37c4-41a0-a0ed-c608e990767e" returned: 0 in 0.328s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "cinder-quobyte-66e5655d-37c4-41a0-a0ed-c608e990767e" released by "delete_volume" :: held 0.901s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Created reservations ['3597b3f3-8b02-41fb-a8df-d21fbd7c02e5', '0cb31059-6d7a-4c4a-ac6f-420654fa0a03', 'fe8be838-c367-4a81-948b-71632ba1a28c', 'c35e0191-0af2-43a8-b2fc-c47ab79f7f36'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:35 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.info" returned: 0 in 0.335s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:35 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2e0c2636-94f5-4252-bd90-8e3b30c943e2 tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:35 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:35 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:35 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:36 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.273s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:36 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Deleted volume successfully. Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-d7713655-b2c3-4381-9523-ec36815137d3 tempest-ProjectReaderTests-562863205 None] Lock "cinder-66e5655d-37c4-41a0-a0ed-c608e990767e-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-1dc10776-8885-4a8c-8471-aaa81ae2cdcc-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-1dc10776-8885-4a8c-8471-aaa81ae2cdcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-1dc10776-8885-4a8c-8471-aaa81ae2cdcc" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-1dc10776-8885-4a8c-8471-aaa81ae2cdcc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 1dc10776-8885-4a8c-8471-aaa81ae2cdcc of volume 8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934864e-0f0a-42f7-95db-88e059eb0806]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:36 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:36 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc Nov 03 17:42:36 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:37 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc" returned: 0 in 0.464s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e46c4df-d1a1-4a17-a914-4369e622b99b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16bf7f-4fd0-428a-ba04-2474c1ef0b4d]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:37 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b Nov 03 17:42:37 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:37 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b" returned: 0 in 0.462s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:37 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:37 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc Nov 03 17:42:37 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:38 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc" returned: 0 in 0.403s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:38 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc Nov 03 17:42:38 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:38 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b.1dc10776-8885-4a8c-8471-aaa81ae2cdcc" returned: 0 in 0.284s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-1dc10776-8885-4a8c-8471-aaa81ae2cdcc" released by "_delete_snapshot" :: held 1.757s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" released by "delete_snapshot" :: held 1.786s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Created reservations ['06a5f20b-aeff-4e4c-8cf8-958b2c044fed', '7cca515e-d66c-4e1c-b85b-a91b3235b120', '06f6793b-02d4-46d2-835d-794120feaed9', 'a22f737b-ec9a-4626-82eb-abf3f721a038'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:38 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-9df167b8-03a2-467c-ae8c-c6487caaaa08 tempest-ProjectMemberTests-786257033 None] Lock "cinder-1dc10776-8885-4a8c-8471-aaa81ae2cdcc-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-8e46c4df-d1a1-4a17-a914-4369e622b99b-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "cinder-8e46c4df-d1a1-4a17-a914-4369e622b99b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:38 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:38 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:38 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c1d90-c6e6-411e-8767-aa7e7f3e3e9f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:39 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b Nov 03 17:42:39 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:39 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.334s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:42:39 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b" returned: 0 in 0.471s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:39 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b Nov 03 17:42:39 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:39 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8e46c4df-d1a1-4a17-a914-4369e622b99b" returned: 0 in 0.341s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-8e46c4df-d1a1-4a17-a914-4369e622b99b" released by "delete_volume" :: held 0.899s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:39 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Created reservations ['44e19958-f260-4ee2-a5b7-753195b97cdb', 'bc46d42d-7879-4db6-8b31-2ce1d793f2af', '8469f5a2-dd78-4f41-bb27-4a112afa699b', 'e8bb0be3-c227-4e7d-9d83-565ece24fa16'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:40 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:40 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:40 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.264s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:40 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-fde0b59a-b3ec-4b0d-899f-d549e596fe69 tempest-ProjectMemberTests-786257033 None] Lock "cinder-8e46c4df-d1a1-4a17-a914-4369e622b99b-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (3b0b71a7-690c-4af5-a4a7-a4d601e8c11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bfcf83-0bb1-489d-a11c-574ea60d0c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bfcf83-0bb1-489d-a11c-574ea60d0c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970014605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bf8068-8545-4766-9022-7d1245a03968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:41Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9220036f-20f1-48a6-b0cf-433a2d8efff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9220036f-20f1-48a6-b0cf-433a2d8efff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06839bdd-817a-4e71-ab73-8c1f61e983a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06839bdd-817a-4e71-ab73-8c1f61e983a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bf8068-8545-4766-9022-7d1245a03968', 'volume_name': 'volume-61bf8068-8545-4766-9022-7d1245a03968', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e387a39-5e48-44a4-96f2-4153512037b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e387a39-5e48-44a4-96f2-4153512037b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18227770-2c41-4398-8a3e-994395519188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:40 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Volume 61bf8068-8545-4766-9022-7d1245a03968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bf8068-8545-4766-9022-7d1245a03968', 'volume_size': 1} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970014605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bf8068-8545-4766-9022-7d1245a03968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:41Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Creating volume 61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:40 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:40 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:40 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 1073741824 Nov 03 17:42:40 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Flow 'volume_create_manager' (9a2e03e9-fffe-42e6-ac46-97cab0c5051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010e993d-a7eb-436a-acac-40628c7f51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010e993d-a7eb-436a-acac-40628c7f51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895122492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79843a5-bbc5-4753-9223-4e1179b58016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33ff14bd94e40a4a7ef2be17926802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:41Z,use_quota=True,user_id='2c033e6e82a54d71953b2c62d38cb190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d94be4-935d-466d-b8d5-9cf6a55a57b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d94be4-935d-466d-b8d5-9cf6a55a57b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b572a41f-eb43-47d6-ad43-095d65a7662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b572a41f-eb43-47d6-ad43-095d65a7662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79843a5-bbc5-4753-9223-4e1179b58016', 'volume_name': 'volume-c79843a5-bbc5-4753-9223-4e1179b58016', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5c32bc-c4ae-4b5c-9a93-99bc6d138966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5c32bc-c4ae-4b5c-9a93-99bc6d138966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b162d-656d-49a7-8d7b-aee0b7440fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Volume c79843a5-bbc5-4753-9223-4e1179b58016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79843a5-bbc5-4753-9223-4e1179b58016', 'volume_size': 1} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:41 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 1073741824" returned: 0 in 0.464s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:41 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 Nov 03 17:42:41 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:41 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968" returned: 0 in 0.268s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895122492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79843a5-bbc5-4753-9223-4e1179b58016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33ff14bd94e40a4a7ef2be17926802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:41Z,use_quota=True,user_id='2c033e6e82a54d71953b2c62d38cb190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Creating volume c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:41 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:41 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 1073741824 Nov 03 17:42:41 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18227770-2c41-4398-8a3e-994395519188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bf8068-8545-4766-9022-7d1245a03968', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23149ca8-7fec-487d-8a18-e0130dc7527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (9ef3563b-3721-4f04-846d-0ed965510f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72428837-0711-4a6c-82f1-16044cd83511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Volume volume-61bf8068-8545-4766-9022-7d1245a03968 (61bf8068-8545-4766-9022-7d1245a03968): created successfully Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23149ca8-7fec-487d-8a18-e0130dc7527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (3b0b71a7-690c-4af5-a4a7-a4d601e8c11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72428837-0711-4a6c-82f1-16044cd83511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235391415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a1007-023a-416f-ba61-24a5660f6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:42Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de66c8-04dc-4ecc-b2e9-0ecc9d032db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de66c8-04dc-4ecc-b2e9-0ecc9d032db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ee0be7-da6e-455e-8d59-fa9c8a48adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ee0be7-da6e-455e-8d59-fa9c8a48adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020a1007-023a-416f-ba61-24a5660f6c5e', 'volume_name': 'volume-020a1007-023a-416f-ba61-24a5660f6c5e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ae2892-5f4e-4b03-991e-ed04cbdedf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ae2892-5f4e-4b03-991e-ed04cbdedf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc3ced-6737-4a58-a5b2-f40637502c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:41 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Volume 020a1007-023a-416f-ba61-24a5660f6c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020a1007-023a-416f-ba61-24a5660f6c5e', 'volume_size': 1} Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:41 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-067dc976-0cfa-4a1c-8d6f-bb7a2241d00e tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:41 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:41 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 1073741824" returned: 0 in 0.430s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:42 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:42 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:42 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.228s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235391415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a1007-023a-416f-ba61-24a5660f6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:42Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Creating volume 020a1007-023a-416f-ba61-24a5660f6c5e {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:42 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b162d-656d-49a7-8d7b-aee0b7440fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79843a5-bbc5-4753-9223-4e1179b58016', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:42 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e 1073741824 Nov 03 17:42:42 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08053a1-723a-478c-a05f-cb588958a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Volume volume-c79843a5-bbc5-4753-9223-4e1179b58016 (c79843a5-bbc5-4753-9223-4e1179b58016): created successfully Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08053a1-723a-478c-a05f-cb588958a4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Flow 'volume_create_manager' (9a2e03e9-fffe-42e6-ac46-97cab0c5051d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:42 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f1474c2f-75fe-44f3-bd65-58bf444a2ccd tempest-SnapshotDependencyTests-1281191850 None] Created volume successfully. Nov 03 17:42:42 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e 1073741824" returned: 0 in 0.408s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:42 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e Nov 03 17:42:42 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:42 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e" returned: 0 in 0.243s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc3ced-6737-4a58-a5b2-f40637502c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020a1007-023a-416f-ba61-24a5660f6c5e', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83aae1d-914a-4215-82bc-c746e0aeba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Creating offline snapshot 19562028-004a-434e-98d8-3fc94c4e7b47 of volume 61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:42 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Volume volume-020a1007-023a-416f-ba61-24a5660f6c5e (020a1007-023a-416f-ba61-24a5660f6c5e): created successfully Nov 03 17:42:42 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83aae1d-914a-4215-82bc-c746e0aeba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (9ef3563b-3721-4f04-846d-0ed965510f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa9464-4839-4e1b-965b-a9ef9537fef4]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:43 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c471afd1-1509-4f34-b4f2-acb5e2eaed15 tempest-ProjectReaderTests-103579077 None] Created volume successfully. Nov 03 17:42:43 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 Nov 03 17:42:43 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:43 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968" returned: 0 in 0.366s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:43 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 1G Nov 03 17:42:43 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:43 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 1G" returned: 0 in 0.420s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bf8068-8545-4766-9022-7d1245a03968 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-020a1007-023a-416f-ba61-24a5660f6c5e-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:43 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bf8068-8545-4766-9022-7d1245a03968 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 Nov 03 17:42:43 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "cinder-020a1007-023a-416f-ba61-24a5660f6c5e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-quobyte-020a1007-023a-416f-ba61-24a5660f6c5e" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-020a1007-023a-416f-ba61-24a5660f6c5e" acquired by "delete_volume" :: waited 0.014s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[98679c62-c347-4556-9f2d-885cefd372e7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:43 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e Nov 03 17:42:44 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bf8068-8545-4766-9022-7d1245a03968 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47" returned: 0 in 0.298s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 is being set with open permissions: ugo+rw Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 Nov 03 17:42:44 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e" returned: 0 in 0.354s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e Nov 03 17:42:44 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47" returned: 0 in 0.243s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info Nov 03 17:42:44 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-020a1007-023a-416f-ba61-24a5660f6c5e" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-020a1007-023a-416f-ba61-24a5660f6c5e" released by "delete_volume" :: held 0.650s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Created reservations ['18cbf194-385e-4b85-a49a-bdfa6e6f0212', '47669129-3c38-4b2a-914c-5101dfcdb2b3', '44e944f9-ea3a-4de0-950a-feebbe55e79c', 'b34936c2-0922-4952-9a93-5dfd03b0be05'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:44 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info is being set with open permissions: ugo+rw Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info Nov 03 17:42:44 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:44 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:44 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.info" returned: 0 in 0.244s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.561s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:44 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.242s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Creating offline snapshot a680069c-3db7-4a91-b289-3355387115ad of volume c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Deleted volume successfully. Nov 03 17:42:44 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-f9892ba5-b6e4-4f7f-a8e4-bee753d53a2c tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba3944-ab94-4ce1-8e1b-0bf88e3b30d0]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:44 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-b04afbfd-45f2-4b65-ab67-9f0f74f06509 tempest-ProjectReaderTests-103579077 None] Lock "cinder-020a1007-023a-416f-ba61-24a5660f6c5e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:45 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:45 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:45 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.380s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:45 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad 1G Nov 03 17:42:45 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (9b9be3e5-451c-4522-87d2-d4163a5dd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb5912c-1d7f-4b2e-9444-a77866be2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb5912c-1d7f-4b2e-9444-a77866be2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682737294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a320a1-9be6-4046-b20c-257c17b674b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:45Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59cdf3b-06cd-4ded-a1b8-1d48b40300c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59cdf3b-06cd-4ded-a1b8-1d48b40300c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494b626b-e7cd-4bfe-8966-fcde487b7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494b626b-e7cd-4bfe-8966-fcde487b7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a320a1-9be6-4046-b20c-257c17b674b5', 'volume_name': 'volume-b1a320a1-9be6-4046-b20c-257c17b674b5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceacee1-f050-4ff6-b6f5-d53290f64391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceacee1-f050-4ff6-b6f5-d53290f64391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5474ffda-86a6-47bc-a1c9-088ecfb658b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:45 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Volume b1a320a1-9be6-4046-b20c-257c17b674b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a320a1-9be6-4046-b20c-257c17b674b5', 'volume_size': 1} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:45 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad 1G" returned: 0 in 0.404s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:45 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c79843a5-bbc5-4753-9223-4e1179b58016 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:45 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c79843a5-bbc5-4753-9223-4e1179b58016 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:45 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c79843a5-bbc5-4753-9223-4e1179b58016 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.296s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad is being set with open permissions: ugo+rw Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-19562028-004a-434e-98d8-3fc94c4e7b47-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:46 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:46 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-19562028-004a-434e-98d8-3fc94c4e7b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-19562028-004a-434e-98d8-3fc94c4e7b47" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-19562028-004a-434e-98d8-3fc94c4e7b47" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot 19562028-004a-434e-98d8-3fc94c4e7b47 of volume 61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[00598c1c-7a61-4256-a548-d8d48e160112]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 Nov 03 17:42:46 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.250s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info Nov 03 17:42:46 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47" returned: 0 in 0.371s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bf8068-8545-4766-9022-7d1245a03968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b9e4f-e4c4-43d4-afc4-68eea271e02c]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info is being set with open permissions: ugo+rw Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info Nov 03 17:42:46 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 Nov 03 17:42:46 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.info" returned: 0 in 0.250s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682737294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a320a1-9be6-4046-b20c-257c17b674b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:45Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Creating volume b1a320a1-9be6-4046-b20c-257c17b674b5 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:46 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 1073741824 Nov 03 17:42:46 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:46 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-b943df51-d916-4db2-b1a0-875d95de5daf tempest-SnapshotDependencyTests-1281191850 None] Create snapshot completed successfully Nov 03 17:42:46 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968" returned: 0 in 0.364s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:46 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:46 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 Nov 03 17:42:46 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:47 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47" returned: 0 in 0.337s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:47 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47 Nov 03 17:42:47 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:47 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 1073741824" returned: 0 in 0.432s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:47 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 Nov 03 17:42:47 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:47 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968.19562028-004a-434e-98d8-3fc94c4e7b47" returned: 0 in 0.254s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-19562028-004a-434e-98d8-3fc94c4e7b47" released by "_delete_snapshot" :: held 1.421s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" released by "delete_snapshot" :: held 1.445s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:47 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5" returned: 0 in 0.269s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5474ffda-86a6-47bc-a1c9-088ecfb658b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a320a1-9be6-4046-b20c-257c17b674b5', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83450859-d36f-44b0-ab21-615b2027487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Created reservations ['056da316-4a76-4b6c-af4a-21c97652a905', 'fe82dfd1-1761-4cbd-b4b6-915a6c40a2c3', '5a483aa6-1186-4cd8-ab14-8973fe555aa1', '6da5eef4-7e19-497b-b3ea-638d2ee45939'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:47 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Volume volume-b1a320a1-9be6-4046-b20c-257c17b674b5 (b1a320a1-9be6-4046-b20c-257c17b674b5): created successfully Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83450859-d36f-44b0-ab21-615b2027487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (9b9be3e5-451c-4522-87d2-d4163a5dd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-aa30ff79-2c96-4906-a573-d67780403cb0 tempest-ProjectReaderTests-103579077 None] Created volume successfully. Nov 03 17:42:47 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:42:47 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-ca33dbb4-7c96-47dc-9e2e-f3cb9a6bdf74 tempest-ProjectMemberTests-786257033 None] Lock "cinder-19562028-004a-434e-98d8-3fc94c4e7b47-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Flow 'volume_create_manager' (55269f13-6013-405b-98c9-abf34f83d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2015946b-438d-47e3-98a8-70e07741693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2015946b-438d-47e3-98a8-70e07741693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380cf84f-4824-4184-aaea-194144d999e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33ff14bd94e40a4a7ef2be17926802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a680069c-3db7-4a91-b289-3355387115ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:48Z,use_quota=True,user_id='2c033e6e82a54d71953b2c62d38cb190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a025a80e-9771-4d03-a399-18955fb57272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a025a80e-9771-4d03-a399-18955fb57272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4163159f-9e99-45bb-9094-3d2d9c7669c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4163159f-9e99-45bb-9094-3d2d9c7669c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '380cf84f-4824-4184-aaea-194144d999e8', 'volume_name': 'volume-380cf84f-4824-4184-aaea-194144d999e8', 'volume_size': 1, 'snapshot_id': 'a680069c-3db7-4a91-b289-3355387115ad'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3a9c9f-dfeb-47bb-8b70-2e8cc9cc60b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3a9c9f-dfeb-47bb-8b70-2e8cc9cc60b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01af7b3-ffc2-4e49-8328-42b9e7235ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:48 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Volume 380cf84f-4824-4184-aaea-194144d999e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-380cf84f-4824-4184-aaea-194144d999e8', 'volume_size': 1, 'snapshot_id': 'a680069c-3db7-4a91-b289-3355387115ad'} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad-380cf84f-4824-4184-aaea-194144d999e8" by "_create_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad-380cf84f-4824-4184-aaea-194144d999e8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Creating volume 380cf84f-4824-4184-aaea-194144d999e8 from snapshot a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" by "_copy_volume_from_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-61bf8068-8545-4766-9022-7d1245a03968-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] snapshot: a680069c-3db7-4a91-b289-3355387115ad, volume: 380cf84f-4824-4184-aaea-194144d999e8, {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "cinder-61bf8068-8545-4766-9022-7d1245a03968-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2bbfd6-944d-4b89-a0f6-ea7366a2b828]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" acquired by "delete_volume" :: waited 0.012s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d967dc6-4161-4ca3-9e92-8400aa5d3f23]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:48 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:48 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:48 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 Nov 03 17:42:48 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-b1a320a1-9be6-4046-b20c-257c17b674b5-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "cinder-b1a320a1-9be6-4046-b20c-257c17b674b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.399s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c79843a5-bbc5-4753-9223-4e1179b58016(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07b98c-cecd-4019-b318-bec9a79dd434]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-quobyte-b1a320a1-9be6-4046-b20c-257c17b674b5" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-b1a320a1-9be6-4046-b20c-257c17b674b5" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e19a0c-c38b-4c0b-8373-bc0f1bd15c61]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:48 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968" returned: 0 in 0.424s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:48 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:48 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968 Nov 03 17:42:48 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:48 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:48 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:48 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 Nov 03 17:42:48 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:49 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-61bf8068-8545-4766-9022-7d1245a03968" returned: 0 in 0.262s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-61bf8068-8545-4766-9022-7d1245a03968" released by "delete_volume" :: held 0.750s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:49 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.418s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Creating direct copy from snapshot {{(pid=86995) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.utils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Path /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 not found in is_blk_device check {{(pid=86995) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Created reservations ['e8ec838e-cf21-4b1f-a8a3-93ad08f6a72a', 'c51a8653-41b7-49b6-add5-e9d543ae3980', '1921a0f8-32e5-42aa-a97f-fefa8fc5094b', 'c99d79a0-fda2-470e-a5e5-e6813f996140'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:49 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 Nov 03 17:42:49 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:49 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5" returned: 0 in 0.388s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:49 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5 Nov 03 17:42:49 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:49 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:49 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:49 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-b1a320a1-9be6-4046-b20c-257c17b674b5" returned: 0 in 0.283s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-b1a320a1-9be6-4046-b20c-257c17b674b5" released by "delete_volume" :: held 0.719s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:49 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.281s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:49 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Created reservations ['3a1c2544-7fa6-4235-83b0-0b09a5f15888', '5b59b48d-2bc2-4171-a251-d765db83f85a', 'fb9ec8f3-0e62-416c-9754-3cc04a606094', 'ca78ea05-e163-4ab9-a024-8c20ae285eaa'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-839b1060-9362-4410-aeb6-84d0f3619a1c tempest-ProjectMemberTests-786257033 None] Lock "cinder-61bf8068-8545-4766-9022-7d1245a03968-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:49 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:49 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:49 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:50 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.804s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:50 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Deleted volume successfully. Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (69ce4e21-f2ab-4a67-a963-fbbb0e92b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81945f83-97f3-4d09-a282-fc6fd5e27f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-2abf0be5-1530-4d0e-b27b-7e562982ed0c tempest-ProjectReaderTests-103579077 None] Lock "cinder-b1a320a1-9be6-4046-b20c-257c17b674b5-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81945f83-97f3-4d09-a282-fc6fd5e27f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99273796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9a1982-afba-4895-ade2-457f171db498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:50Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a24c65-dfef-4cb7-ada1-5bf712b13795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a24c65-dfef-4cb7-ada1-5bf712b13795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48c61f2-b2c3-4811-9ddc-7af66bfcda36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48c61f2-b2c3-4811-9ddc-7af66bfcda36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9a1982-afba-4895-ade2-457f171db498', 'volume_name': 'volume-da9a1982-afba-4895-ade2-457f171db498', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe220b-e97d-40a6-8a42-9c0f689d253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe220b-e97d-40a6-8a42-9c0f689d253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d8ce5f-7abe-4087-ab1e-d657885a2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:50 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Volume da9a1982-afba-4895-ade2-457f171db498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9a1982-afba-4895-ade2-457f171db498', 'volume_size': 1} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:50 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (d6676567-b67c-4d8f-926f-75eb47b9e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba25b4b5-9ddd-488e-8d60-ebee9d56c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba25b4b5-9ddd-488e-8d60-ebee9d56c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003185660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59508679-830c-440e-943a-ae33a60bf3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:51Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1011a98c-bb10-481b-b679-3440a3e470f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1011a98c-bb10-481b-b679-3440a3e470f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e75a648-4a09-4caa-a624-746e663c983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e75a648-4a09-4caa-a624-746e663c983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59508679-830c-440e-943a-ae33a60bf3a6', 'volume_name': 'volume-59508679-830c-440e-943a-ae33a60bf3a6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4d1f37-5887-4c3b-910b-618bfe988ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4d1f37-5887-4c3b-910b-618bfe988ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e36e05-bdc1-4705-b5ad-d7f0270bd3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:51 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Volume 59508679-830c-440e-943a-ae33a60bf3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59508679-830c-440e-943a-ae33a60bf3a6', 'volume_size': 1} Nov 03 17:42:51 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:55 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8" returned: 0 in 6.133s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.image.image_utils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Image conversion details: src /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 {{(pid=86995) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:42:55 devstack cinder-volume[86995]: INFO cinder.image.image_utils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Converted 1024.00 MB image at 166.95 MB/s Nov 03 17:42:55 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 is being set with open permissions: ugo+rw Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:55 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 Nov 03 17:42:55 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:55 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8" returned: 0 in 0.228s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" released by "_copy_volume_from_snapshot" :: held 7.277s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=187,cinder:INSERT=63,cinder:UPDATE=236,cinder:DELETE=27 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=196,cinder:INSERT=73,cinder:UPDATE=273,cinder:DELETE=15 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad-380cf84f-4824-4184-aaea-194144d999e8" released by "_create_volume_from_snapshot" :: held 7.350s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.366s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.883s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99273796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9a1982-afba-4895-ade2-457f171db498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522208a8c00f475b88862dab1ac8b6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:50Z,use_quota=True,user_id='e0796ac4a27548dea58bc79c44ffd186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Creating volume da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:55 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:55 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 1073741824 Nov 03 17:42:55 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01af7b3-ffc2-4e49-8328-42b9e7235ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380cf84f-4824-4184-aaea-194144d999e8', 'volume_size': 1, 'snapshot_id': 'a680069c-3db7-4a91-b289-3355387115ad'}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad99d33-48e4-41c7-9bcf-c273bc85523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:55 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Volume volume-380cf84f-4824-4184-aaea-194144d999e8 (380cf84f-4824-4184-aaea-194144d999e8): created successfully Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad99d33-48e4-41c7-9bcf-c273bc85523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Flow 'volume_create_manager' (55269f13-6013-405b-98c9-abf34f83d22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:55 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-7fb227f2-0a85-47ea-8e25-1ec12e447725 tempest-SnapshotDependencyTests-1281191850 None] Created volume successfully. Nov 03 17:42:55 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 1073741824" returned: 0 in 0.394s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:55 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:56 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 Nov 03 17:42:56 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:56 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498" returned: 0 in 0.240s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.085s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003185660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59508679-830c-440e-943a-ae33a60bf3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:51Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Creating volume 59508679-830c-440e-943a-ae33a60bf3a6 {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:56 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d8ce5f-7abe-4087-ab1e-d657885a2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9a1982-afba-4895-ade2-457f171db498', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:56 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 1073741824 Nov 03 17:42:56 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894149b9-4f0e-4c5b-8dde-854e2e3f2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:56 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Volume volume-da9a1982-afba-4895-ade2-457f171db498 (da9a1982-afba-4895-ade2-457f171db498): created successfully Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894149b9-4f0e-4c5b-8dde-854e2e3f2be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Flow 'volume_create_manager' (69ce4e21-f2ab-4a67-a963-fbbb0e92b43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:56 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-2886661d-827c-4ab6-ac4c-e116ff1f9fb2 tempest-ProjectMemberTests-786257033 None] Created volume successfully. Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:56 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 1073741824" returned: 0 in 0.502s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:56 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 Nov 03 17:42:56 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-a680069c-3db7-4a91-b289-3355387115ad-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-a680069c-3db7-4a91-b289-3355387115ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Deleting offline snapshot a680069c-3db7-4a91-b289-3355387115ad of volume c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] snapshot_file for this snap is: volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8baf8b-2cf1-49bf-8da5-ecf6c110d37f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:57 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6" returned: 0 in 0.251s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.390s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e36e05-bdc1-4705-b5ad-d7f0270bd3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59508679-830c-440e-943a-ae33a60bf3a6', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a218d6-fcc9-470a-b9ab-8b11595f5118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Creating offline snapshot a3edbe76-2ad1-4467-9ebb-924eeb042f6c of volume da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:42:57 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Volume volume-59508679-830c-440e-943a-ae33a60bf3a6 (59508679-830c-440e-943a-ae33a60bf3a6): created successfully Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a218d6-fcc9-470a-b9ab-8b11595f5118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (d6676567-b67c-4d8f-926f-75eb47b9e622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea12b5-b18d-4bd7-8621-45b344e411c7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-793e1856-4bb3-4321-8f65-8bd28014ea26 tempest-ProjectReaderTests-103579077 None] Created volume successfully. Nov 03 17:42:57 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 Nov 03 17:42:57 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.389s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c79843a5-bbc5-4753-9223-4e1179b58016(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f7c868-6958-4955-bef8-3f80e86c1c42]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-59508679-830c-440e-943a-ae33a60bf3a6-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "cinder-59508679-830c-440e-943a-ae33a60bf3a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-quobyte-59508679-830c-440e-943a-ae33a60bf3a6" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-59508679-830c-440e-943a-ae33a60bf3a6" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:57 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:57 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[376950fe-7434-42a3-91ae-2b9d3e4cde5a]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c 1G {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c 1G Nov 03 17:42:57 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 Nov 03 17:42:57 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6" returned: 0 in 0.359s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6 Nov 03 17:42:57 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.565s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:57 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:57 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:57 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c 1G" returned: 0 in 0.466s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:57 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9a1982-afba-4895-ade2-457f171db498 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:58 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9a1982-afba-4895-ade2-457f171db498 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c Nov 03 17:42:58 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:58 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-59508679-830c-440e-943a-ae33a60bf3a6" returned: 0 in 0.265s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-59508679-830c-440e-943a-ae33a60bf3a6" released by "delete_volume" :: held 0.668s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Created reservations ['14b2ea73-b895-4ddf-8e2d-50f24636697b', 'a1536007-13fe-41b2-8992-4c1b20e2e6cd', 'f21490dc-06c1-48c9-a8a2-addb74c7f01e', 'a8001453-ebf0-4baa-85ed-fb7691af6a53'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:58 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.395s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:58 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:58 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad Nov 03 17:42:58 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:58 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9a1982-afba-4895-ade2-457f171db498 -F qcow2 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c" returned: 0 in 0.363s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c is being set with open permissions: ugo+rw Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:58 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c Nov 03 17:42:58 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:58 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.322s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:42:58 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Deleted volume successfully. Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016.a680069c-3db7-4a91-b289-3355387115ad" returned: 0 in 0.308s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-8b12ef37-b9db-402a-b51a-70065b7021e6 tempest-ProjectReaderTests-103579077 None] Lock "cinder-59508679-830c-440e-943a-ae33a60bf3a6-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-a680069c-3db7-4a91-b289-3355387115ad" released by "_delete_snapshot" :: held 1.796s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" released by "delete_snapshot" :: held 1.818s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:58 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c" returned: 0 in 0.352s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:58 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info Nov 03 17:42:58 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Created reservations ['75ab8597-0881-4240-ba8a-379bddf7ce94', '6ff83ef2-6e1b-4757-bd93-84688510c550', 'eb70af0a-7ef7-4bfd-afc8-6466e56a6312', '54b5fa23-2a43-41ff-bbc3-6f719e13c409'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Delete snapshot completed successfully. Nov 03 17:42:58 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c5ee9edb-5991-427b-94d1-9568da0121b9 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-a680069c-3db7-4a91-b289-3355387115ad-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-c79843a5-bbc5-4753-9223-4e1179b58016-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-c79843a5-bbc5-4753-9223-4e1179b58016-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:59 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info" returned: 0 in 0.342s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:59 devstack cinder-volume[86995]: WARNING cinder.volume.drivers.remotefs [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info is being set with open permissions: ugo+rw Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:42:59 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info Nov 03 17:42:59 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" acquired by "delete_volume" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[469d4155-f47a-4533-83ae-1c07a48ec849]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86995) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (962c1d13-7418-4cd3-9f18-72a42a44bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e604cc33-c15a-4215-ad1c-69be5adffd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e604cc33-c15a-4215-ad1c-69be5adffd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652396304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be548de-d458-4762-96e7-3435382916ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:59Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf09c43-c8ff-4fa0-b781-f9fb14511e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf09c43-c8ff-4fa0-b781-f9fb14511e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d7e01a-d5c9-4f63-befc-5033ebe11c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d7e01a-d5c9-4f63-befc-5033ebe11c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be548de-d458-4762-96e7-3435382916ab', 'volume_name': 'volume-8be548de-d458-4762-96e7-3435382916ab', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cb737e-a6f8-4c18-bd16-50a899b17ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cb737e-a6f8-4c18-bd16-50a899b17ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b238e88-e5ec-40e9-92f0-d34a811799fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:42:59 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Volume 8be548de-d458-4762-96e7-3435382916ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be548de-d458-4762-96e7-3435382916ab', 'volume_size': 1} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:59 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:59 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:59 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.info" returned: 0 in 0.257s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652396304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be548de-d458-4762-96e7-3435382916ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488ec3a8b074fff9f51d699d3f28e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:42:59Z,use_quota=True,user_id='aa9f391c5db84fd88efe5fdeccf090f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49762e3-a79d-4f5b-ab9d-83a17624790d),volume_type_id=c49762e3-a79d-4f5b-ab9d-83a17624790d)}" {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Creating volume 8be548de-d458-4762-96e7-3435382916ab {{(pid=86995) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Selected osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 as target Quobyte volume. {{(pid=86995) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:42:59 devstack cinder-volume[86995]: INFO cinder.volume.drivers.remotefs [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] casted to osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3 Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab 1073741824 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab 1073741824 Nov 03 17:42:59 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:59 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-891189d6-7c07-4aa5-908b-3ec802d07ed9 tempest-ProjectMemberTests-786257033 None] Create snapshot completed successfully Nov 03 17:42:59 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.373s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016 Nov 03 17:42:59 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:59 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-c79843a5-bbc5-4753-9223-4e1179b58016" returned: 0 in 0.252s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:59 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab 1073741824" returned: 0 in 0.442s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-c79843a5-bbc5-4753-9223-4e1179b58016" released by "delete_volume" :: held 0.699s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab Nov 03 17:42:59 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Created reservations ['a5d22394-b12d-4317-9d47-200398b7c2bf', 'f0a13d73-6b7a-45cb-b34b-9fdbc9f2365b', '55c8df6e-6106-41c8-85b2-4b183752d749', '1445b5e6-dce3-44be-9630-01f2e9c9fe4f'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:42:59 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-a3edbe76-2ad1-4467-9ebb-924eeb042f6c-delete_snapshot" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:00 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:43:00 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-a3edbe76-2ad1-4467-9ebb-924eeb042f6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" by "delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-a3edbe76-2ad1-4467-9ebb-924eeb042f6c" by "_delete_snapshot" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-a3edbe76-2ad1-4467-9ebb-924eeb042f6c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Deleting offline snapshot a3edbe76-2ad1-4467-9ebb-924eeb042f6c of volume da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] snapshot_file for this snap is: volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eec69f-4a55-47cb-b145-909d552ddf8e]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:00 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab" returned: 0 in 0.278s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'} {{(pid=86995) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b238e88-e5ec-40e9-92f0-d34a811799fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be548de-d458-4762-96e7-3435382916ab', 'volume_size': 1}' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9236e2e-9341-402b-bdf1-57484d5cb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:43:00 devstack cinder-volume[86995]: INFO cinder.volume.flows.manager.create_volume [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Volume volume-8be548de-d458-4762-96e7-3435382916ab (8be548de-d458-4762-96e7-3435382916ab): created successfully Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9236e2e-9341-402b-bdf1-57484d5cb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86995) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Flow 'volume_create_manager' (962c1d13-7418-4cd3-9f18-72a42a44bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86995) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:43:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-18e851de-ae8b-4b4f-bd3c-db4c1b4f74ba tempest-ProjectReaderTests-103579077 None] Created volume successfully. Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-380cf84f-4824-4184-aaea-194144d999e8-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-380cf84f-4824-4184-aaea-194144d999e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:00 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c Nov 03 17:43:00 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.328s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:43:00 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Deleted volume successfully. Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" acquired by "delete_volume" :: waited 0.026s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-0a247c73-33a5-4da2-b51c-db66390082d1 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-c79843a5-bbc5-4753-9223-4e1179b58016-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9dbe2-a0de-4d0e-9b5b-25e73f26784f]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:00 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 Nov 03 17:43:00 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c" returned: 0 in 0.417s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.remotefs [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da9a1982-afba-4895-ade2-457f171db498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86995) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eaf487-2568-40b5-ba29-818b0f802f6b]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:00 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 Nov 03 17:43:00 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8" returned: 0 in 0.369s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:00 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8 Nov 03 17:43:00 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498" returned: 0 in 0.351s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:00 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c Nov 03 17:43:00 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:00 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-380cf84f-4824-4184-aaea-194144d999e8" returned: 0 in 0.243s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:00 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-quobyte-380cf84f-4824-4184-aaea-194144d999e8" released by "delete_volume" :: held 0.663s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Created reservations ['dc49ea4b-cec0-4344-bf6d-91e042714e7a', '9f80fc25-b2a4-454a-8cf8-d044d08cc727', 'e00573f8-a579-4ce6-834a-ef55af86483a', 'ff8a0bb7-fab1-41bd-b209-63fdc8d6cbbd'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:01 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:43:01 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-8be548de-d458-4762-96e7-3435382916ab-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:01 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c" returned: 0 in 0.411s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "cinder-8be548de-d458-4762-96e7-3435382916ab-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:01 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c Nov 03 17:43:01 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:01 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Acquiring lock "cinder-quobyte-8be548de-d458-4762-96e7-3435382916ab" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.305s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:43:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Deleted volume successfully. Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-8be548de-d458-4762-96e7-3435382916ab" acquired by "delete_volume" :: waited 0.023s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-e1fc0e26-7232-408b-8fc9-2995c1908bc8 tempest-SnapshotDependencyTests-1281191850 None] Lock "cinder-380cf84f-4824-4184-aaea-194144d999e8-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[05524c80-491f-45ff-9b27-8901954bd0c3]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:01 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab Nov 03 17:43:01 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:01 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498.a3edbe76-2ad1-4467-9ebb-924eeb042f6c" returned: 0 in 0.329s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-a3edbe76-2ad1-4467-9ebb-924eeb042f6c" released by "_delete_snapshot" :: held 1.636s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" released by "delete_snapshot" :: held 1.666s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Created reservations ['b5a7f670-32f5-465b-a203-0b043e24cf62', '87f8a1e2-5173-46fc-8564-8074ba15794f', '5bee6bed-703a-403a-bc00-a51023a3433b', 'f784a1c9-0d0a-476a-b17a-65f0093568c1'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:43:01 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Delete snapshot completed successfully. Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-c1c9bb95-d771-42dd-ae83-58d00f794a3d tempest-ProjectMemberTests-786257033 None] Lock "cinder-a3edbe76-2ad1-4467-9ebb-924eeb042f6c-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:01 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab" returned: 0 in 0.406s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:01 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:01 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab Nov 03 17:43:01 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:02 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-8be548de-d458-4762-96e7-3435382916ab" returned: 0 in 0.261s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-da9a1982-afba-4895-ade2-457f171db498-delete_volume" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "cinder-quobyte-8be548de-d458-4762-96e7-3435382916ab" released by "delete_volume" :: held 0.738s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "cinder-da9a1982-afba-4895-ade2-457f171db498-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Created reservations ['88c7279e-f358-4051-94ae-d46a45b4dddf', '9fc513c2-e875-46fb-853c-f1005020e3ca', '5a46dfc7-8a26-44c2-8779-3c67e5874f79', '699e9d38-d080-46d4-886d-ef0e1b6b4406'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Acquiring lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" by "delete_volume" {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" acquired by "delete_volume" :: waited 0.021s {{(pid=86995) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3f939-e11c-44b4-9a92-b34c36285dc7]: (4, 'qcow2') {{(pid=88199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:02 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:43:02 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:02 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 Nov 03 17:43:02 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:02 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.298s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:43:02 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Deleted volume successfully. Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-72893ab5-a831-4ed2-8c74-4364b5503bdb tempest-ProjectReaderTests-103579077 None] Lock "cinder-8be548de-d458-4762-96e7-3435382916ab-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:02 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498" returned: 0 in 0.525s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:02 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:02 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498 Nov 03 17:43:02 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:03 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477/volume-da9a1982-afba-4895-ade2-457f171db498" returned: 0 in 0.277s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "cinder-quobyte-da9a1982-afba-4895-ade2-457f171db498" released by "delete_volume" :: held 0.909s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.quota [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Created reservations ['2e843106-3e8c-4ed8-8c5e-5b69272dd974', '3b0cfad8-422d-4f68-9fdf-d246ba97d209', 'b9868412-ea94-4823-a81c-93da3f016f4c', '43172c69-34ae-4bcd-b12c-c8c65ae9034a'] {{(pid=86995) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:03 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:43:03 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:03 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.282s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:43:03 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Deleted volume successfully. Nov 03 17:43:03 devstack cinder-volume[86995]: DEBUG cinder.coordination [None req-471d8ab4-50fd-428f-ba5b-acd9acc63e25 tempest-ProjectMemberTests-786257033 None] Lock "cinder-da9a1982-afba-4895-ade2-457f171db498-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86995) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:43:13 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=46,cinder:UPDATE=61,cinder:DELETE=5,cinder:INSERT=18 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:43:13 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=39,cinder:INSERT=15,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3': None} {{(pid=86995) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG cinder.volume.drivers.quobyte [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c1ce7aa-75ba-4eb5-bbae-5dd8db9b9eb3'] {{(pid=86995) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86995) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:43:38 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:43:38 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477 Nov 03 17:43:38 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:43:39 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Nov 03 17:43:39 devstack cinder-volume[86995]: DEBUG oslo_concurrency.processutils [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/557b6e4ec76ee9bea5ca18908b41f477" returned: 0 in 0.235s {{(pid=86995) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:43:39 devstack cinder-volume[86995]: DEBUG cinder.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Notifying Schedulers of capabilities ... {{(pid=86995) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:43:39 devstack cinder-volume[86995]: DEBUG oslo_service.periodic_task [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] Running periodic task VolumeManager._thread_info {{(pid=86995) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:43:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread count: 28 {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:43:39 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-cd135eb5-5bcc-4436-a974-235b2567ba31 None None] thread info: [<_MainThread(MainThread, started 138248565035136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86995) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:43:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:43:48 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}